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Abstract. — We compute Haar ensemble averages of ratios of random characteristic 
polynomials for the classical Lie groups K = Oat, S>On, and USp^. To that end, we 
start from the Clifford- Weyl algebra in its canonical realization on the complex of 
holomorphic differential forms for a C-vector space Vq . From it we construct the Fock 
representation of an orthosymplectic Lie superalgebra osp associated to Vb . Particular 
attention is paid to defining Howe's oscillator semigroup and the representation that par- 
tially exponentiates the Lie algebra representation of sp C osp. In the process, by pushing 
the semigroup representation to its boundary and arguing by continuity, we provide a 
construction of the Shale- Weil-Segal representation of the metaplectic group. 

To deal with a product of n ratios of characteristic polynomials, we let Vq — €."® 
where is equipped with the standard TiT-representation, and focus on the subspace .^f 
of /T-equivariant forms. By Howe duality, this is a highest-weight irreducible representa- 
tion of the centralizer g of Lie{K) in osp. We identify the ^T-Haar expectation of n ratios 
with the character of this g-representation, which we show to be uniquely determined by 
analyticity, Weyl group invariance, certain weight constraints and a system of differential 
equations coming from the Laplace-Casimir invariants of g. We find an explicit solution 
to the problem posed by all these conditions. In this way, we prove that the said Haar 
expectations are expressed by a Weyl-type character formula for all integers N >l. This 
completes earlier work of Conrey, Farmer, and Zirnbauer for the case of Un ■ 



Contents 

Introduction 

1.1. Comparison with results of other approaches 

1.2. Howe duality and weight expansion 

1.3. Group representation and differential equations 

Howe dual pairs in the orthosymplectic Lie superalgebra 

2.1. Notion of Lie superalgebra _ 

2.1.1. Supertrace § 

2.1.2. Universal enveloping algebra 

2.2. Structure of osp (W^) [lOl 

2.2.1. Roots and root spaces IJ 

2.2.2. Casimir elements l4 



2 



A. HUCKLEBERRY, A. PUTTMANN AND M.R. ZIRNBAUER 



2.3. Howe pairs in osp 

2.4. Clifford- Weyl algebra q{W) 

2.5. osp(W') inside q(W') 

2.6. Spinor-oscillator representation 

2.6.1. Weight constraints 

2.6.2. Positive and simple roots 

2.6.3. Unitary structure 

2.7. Real structures 

3. Semigroup representation 

3.1. The oscillator semigroup 

3.1.1. Contraction semigroup: definitions, basic properties 

3.1.2. Actions of Spu 

3. 1 .3. Cone realization of M 

3.2. Oscillator semigroup and metaplectic group 

3.2. 1 . Lifting the semigroup 

3.2.2. Actions of the metaplectic group 

3.2.3. Lifting involutions 

3.3. Oscillator semigroup representation 

3.3.1. Cayley transformation 

3.3.2. Construction of the semigroup representation 

3.3.3. Basic conjugation formula 

3.3.4. Spectral decomposition and operator bounds 

3.4. Representation of the metaplectic group 

3.4.1. The trace-class property 

3.5. Compatibility with Lie algebra representation 

4. The extended character 

4.1. Generalities on Lie supergroup representations 

4.1.1. Gras smann envelopes 

4.1.2. Lie supergroups 

4. 1 .3. Representation of q by superderivations 

4. 1.4. Representations and characters of Lie supergroups . 

4.2. Character of the spinor-oscillator representation 

4.2.1. Spinor-oscillator character as a radial superfunction 

4.2.2. Numerical part of the character 

4.3. Formula for the character 

4.3.1. Extended character 

4.3.2. Weyl group 

4.3.3. Laplace-Casimir eigenvalues 

4.3.4. Differential equations for the character 

4.3.5. Uniqueness theorem 

4.3.6. Explicit solution of the differential equations 

4.3.7. Weight constraints 

References 



HAAR EXPECTATIONS OF RATIOS 



3 



1. Introduction 

In this article we derive an explicit formula for the average 

I{t) := [ Z{t,k)dk 
Jk 

where K is one of the classical compact Lie groups , SOa? , or USp^y equipped with 
Haar measure dk of unit mass jf.dk= 1 and 

jj[ Det(e2'^'ildw-e-2'?'iyt) 

depends on a set of complex parameters t := (e^^'i , . . . , e"''", e'^i , . . . , e*^"), which satisfy 
D^e (^j > for all j = 1 , . . . , n . The case of ^ = Ua^ is handled in [,4J . Note that 

^ ' jj[ Det(Idw-e-'^U) 

with Xm = y Lj=i(iV^; ~ ^j)- This means that Z{t,k) is a product of ratios of charac- 
teristic polynomials, which explains the title of the article. 

The Haar average I{t) can be regarded as the (numerical part of the) character of an 
irreducible representation of a Lie supergroup (g , G) restricted to a suitable subset of 
a maximal torus of G. The Lie superalgebra q is the Howe dual partner of the compact 
group K in an orthosymplectic Lie superalgebra osp . It is naturally represented on 
a certain infinite-dimensional spinor-oscillator module a{V) - more concretely, the 
complex of holomorphic differential forms on the vector space C" ® - and the 
irreducible representation is that on the subspace a{V)^ of ^-equivariant forms. 

To even define the character, we must exponentiate the representation of the Lie 
algebra part of osp on a{V). This requires going to a completion jz/y of a{V), and 
can only be done partially. Nevertheless, the represented semigroup contains enough 
structure to derive Laplace-Casimir differential equations for its character. 

Our explicit formula for I{t) looks exactly like a classical Weyl formula and is de- 
rived in terms of the roots of the Lie superalgebra g and the Weyl group W. Let us state 
this formula for K = Oa^, USp^ without going into the details of the A-positive even 
and odd roots and ^ and the Weyl group W (see ^4. 3. 21 for precise formulas). 
If Wx is the isotropy subgroup of W fixing the highest weight A = Ayy , then 

Mew/W;, llaeA+oU e ' ^ 

To prove this formula we establish certain properties of I{t) which uniquely character- 
ize it and are satisfied by the right-hand side. These are a weight expansion of I{t) (see 
Corollary 14.11) . restrictions on the set of weights (see Corollary 12.31) . and the fact that 
I{t) is annihilated by certain invariant differential operators (see Corollary 14.21) . 

As was stated above, the case K = Uj^ is treated in [4J. Here, we restrict to the 
compact groups K = On, K = USp^, and K = SOn ■ The cases K = Oyy and K = 
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USp^ can be treated simultaneously. Having established formula (11.11 ) for K = , the 
following argument gives a similar result for K = SOn . Let dko and dhgo be the unit 
mass Haar measures for and SOn , respectively. The Oyy-measure (1 + Detk)dko 
has unit mass on SOyv and zero mass on = Oa? \ SOa? . It is SOA^-invariant. Now, 

hoA^)= [ Z{t,k)dkso= f Z{t,k){\+Detk)dko 

JsOn JOn 

= I Z{t,k)dko+ [ Z{t,k)Dct{k)dko = Io^it) + i-lfhAt') 

JOn JOn 

with = (e-^'^i,ei'^2,...,e*'^«,e^i,...,e^«), since Det{k)Z{t,k) = {-l)^Z{t',k). 

1.1. Comparison with results of other approaches. — To facilitate the comparison 
with related work, we now present our final results in the following explicit form. Let 
Xj := e^"''' and yi := e"*^'. Consider first the case of the unitary symplectic group 
K = USp^ (where A'^ G 2N). Then for any pair of non-negative integers p,q in the 
range q — p < N + I one directly infers from (11.11 ) the formula 

r nLiDet(i-x,.) ^^^ uL,xl^''''^nUii-4'yi) 

J nLiDet(l -yiu) ^^f^^- llk<^{l -xl%nUi<,'{l -ym') ' 

The sum on the right-hand side is over sign configurations e = (ci, . . . , Ep) e {±1}''. 
The proof proceeds by induction in p , starting from the result (11.11) for p = q and 
sending Xp to pass from p to p — 1. In published recent work [|5l |3l the same 
formula was derived under the more restrictive condition q<N/2. In [[3l this unwanted 
restriction on the parameter range came about because the numerator and denominator 
on the left-hand side were expanded separately, ignoring the supersymmetric Howe 
duality (see ^of the present paper) of the problem at hand. 

For K = SOa? the same induction process starting from (11.11 ) yields the result 

3^ nLiDet(i-yzi.) " eehv'^k<k'(^-4'4')ni<i'il-yiyr) 

as long asq — p<N— I. Please note that this includes even the case of the trivial 
group K = SO I = {Id} with any p = q> 0. For K = Of^ one has an analogous result 
where the sum on the right-hand side is over e with an even number of sign reversals. 

The very same formulas for SOa^ and Oa^ were derived in the recent literature [HI SI 
but, again, only in the much narrower range q < lnt[N/2]. 

1.2. Howe duality and weight expansion. — To find an explicit expression for the 
integral I{t), we first of all observe that the integrand Z{t,k) is the supertrace of a 
representation p of a semigroup (Ti x r+) x ^ on the spinor-oscillator module a{V) 
(cf. Lemma |43] ). More precisely, we start with the standard ^-representation space 
C^, the Z2-graded vector space U = Uq®Ui with Us — C", and the abelian semigroup 

Ti X r+ := {(diag(e^'^i, . . . ,e^'^''),diag(e^', • • • ,6"^")) I 9^e(^), > , J = 1, . . . ,n} 
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of diagonal transformations in GL(f/i) x GL([/o)- We then consider the vector space 
V := U which is Z2-graded by Vs = t/^ (8) C^, the infinite-dimensional spinor- 
oscillator module a{V) := A{V^) 0S{Vq), and a representation p of {Ti x x K on 
a{V). We also let V ®V* =:W = Wq®Wi (not the Weyl group). 

Averaging the product of ratios Z{t,k) with respect to the compact group K corre- 
sponds to the projection from a{V) onto the vector space a(y)^ of ^-invariants (Corol- 
lary l4.1l) . Now, Howe duality (Proposition l2.2l) implies that g.{V)^ is the representation 
space for an irreducible highest-weight representation of the Howe dual partner g 
of K in the orthosymplectic Lie superalgebra osp(W^). This representation p^ is con- 
structed by realizing g C osp(W^) as a subalgebra in the space of degree-two elements 
of the Clifford- Weyl algebra q(W). Precise definitions of these objects, their relation- 
ships, and the Howe duality statement can be found in ^ 

Using the decomposition aiV)^ = ©y^r^y into weight spaces, Howe duality leads 
to the weight expansion /(e^) = STrjj((/)x eP*W = ^^^^^ByC^^^^ for t = e^ eTixT+. 
Here STr denotes the supertrace. There are strong restrictions on the set of weights 
r. Namely, if 7 G F, then 7 = T.'j=i i^f^jVj — '^j^j) ^^d —j<mj<^< nj for all j . 
The coefficients By ~ STryy(Id) are the dimensions of the weight spaces (multiplied by 
parity). Note that the set of weights of the representation p* of q on a{V)^ is infinite. 

1.3. Group representation and differential equations. — Before outlining the strat- 
egy for computing our character in the infinite-dimensional setting of representations 
of Lie superalgebras and groups, we recall the classical situation where p* is an ir- 
reducible finite-dimensional representation of a reductive Lie algebra q and p is the 
corresponding Lie group representation of the complex reductive group G. In that case 
the character of p, which automatically exists, is the trace Trp, which is a radial 
eigenfunction of every Laplace-Casimir operator. These differential equations can be 
completely understood by their behavior on a maximal torus of G. 

In our case we must consider the infinite-dimensional irreducible representation p* 
of the Lie superalgebra g = osp on a{V)^. Casimir elements, Laplace-Casimir opera- 
tors of osp, and their radial parts have been described by Berezin [1]. In the situation 
C/q — f^i at hand we have the additional feature that every osp-Casimir element / can be 
expressed as a bracket / = [d,F] where d is the holomorphic exterior derivative when 
we view a{V)^ as the complex of A'-equivariant holomorphic differential forms on Vq . 

To benefit from Berezin's theory of radial parts, we construct a radial superfunction 
X which is defined on an open set containing the torus Ti x r+ such that its numerical 
part satisfies numx{t) = I{t) for all t eT\xT^. If we had a representation {p*,p) of 
a Lie supergroup (osp, G) at our disposal, we could define x to be its character, i.e. 

Xig) = STr^^y)Kp{g)c^J^^P*^^J^ 

(see §14.1.41) . Since we don't have such a representation, our idea is to define as a 
character on a totally real submanifold M of maximal dimension which contains a real 
form of Ti x and is invariant with respect to conjugation by a real form Gr of G, 
and then to extend x by analytic continuation. 
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Thinking classically we consider the even part of the Lie superalgebra osp ( Wq ®Wi), 
which is the Lie algebra o ( W^i ) ©5p (Wq). The real structures at the Lie supergroup level 
come from a real form VFr of W. The associated real forms of o{Wi) and sp(Wb) are 
the real orthogonal Lie algebra o(W^i,r) and the real symplectic Lie algebra sp(W(),r). 
These are defined in such a way that the elements in o(Wi,r) ©sp(W(),e) and il% 
are mapped as elements of the Clifford-Weyl algebra via the spinor-oscillator repre- 
sentation to anti-Hermitian operators on a{V) with respect to a compatibly defined 
unitary structure. In this context we frequently use the unitary representation of the 
real Heisenberg group exp(iW(),R) x Ui on the completion £/y of the module a{V). 

Since A{V^) has finite dimension, exponentiating the spinor representation of o(Wi,r) 
causes no difficulties. This results in the spinor representation of Spin(VKi r), a 2:1 
covering of the compact group SO(Wi r). So in this case one easily constructs a rep- 
resentation Ri : Spin(Wi,R) \J{a{V)) which is compatible with p-^\o{Wi «)• 

Exponentiating the oscillator representation of sp(Wo,r) on the infinite-dimensional 
vector space S{Vq) requires more effort. In ^3.4[ following Howe [8], we construct 
the Shale- Weil-Segal representation i?' : Mp(Wo,R) \J{£/v) of the metaplectic group 
Mp(Wo,r) which is the 2:1 covering group of the real symplectic group Sp(Wo,r). 
This is compatible with p*|5p(vi/ojj)- Altogether we see that the even part of the Lie 
superalgebra representation integrates to Gr = Spin(V7i r) Mp(W(),r) . 

The construction of R' uses a limiting process coming from the oscillator semigroup 
H(WJ), which is the double covering of the contraction semigroup H(Wq) C Sp(Wo) 
and has Mp(Wo,r) in its boundary. Furthermore, we have H(Wq) = Mp(Wo,r) x M 
where M is an analytic totally real submanifold of maximal dimension which contains 
a real form of the torus (see S3. 21) . The representation Rq : H(Wq) End(^v') 
constructed in S3.3| facilitates the definition of the representation R' and of the character 
X in S4.2I It should be underlined that Proposition 13.241 ensures convergence of the 
superfunction x{h), which is defined as a supertrace and exists for all h E H(Wq). 

On that basis, the key idea of our approach is to exploit the fact that every Casimir 
invariant I E U(0) is exact in the sense that / = [d,F]. By a standard argument, this 
exactness property implies that every such invariant / vanishes in the spinor-oscillator 
representation. This result in turn implies for our character x the differential equations 
D{I)x = where D{I) is the Laplace-Casimir operator representing /. By drawing on 
Berezin's theory of radial parts, we derive a system of differential equations which in 
combination with certain other properties ultimately determines X- 

In the case of ^ = On the Lie group associated to the even part of the real form of 
the Howe partner q is embedded in a simple way in the full group Gr described above. 
It is itself just a lower-dimensional group of the same form. In the case of ^ = USp^ a 
sort of reversing procedure takes places and the analogous real form is USp2„ x SOj,,. 
Nevertheless, the precise data which are used as input into the series developments, the 
uniqueness theorem and the final calculations of x are essentially the same in the two 
cases. Therefore there is no difficulty handling them simultaneously. 
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2. Howe dual pairs in the orthosymplectic Lie superalgebra 

In this chapter we collect some foundational information from representation theory. 
Basic to our work is the orthosymplectic Lie superalgebra, osp , in its realization as the 
space spanned by supersymmetrized terms of degree two in the Clifford- Weyl algebra. 
Representing the latter by its fundamental representation on the spinor-oscillator mod- 
ule, one gets a representation of osp and of all Howe dual pairs inside of osp . Roots 
and weights of the relevant representations are described in detail. 

2.1. Notion of Lie superalgebra. — A Z2- grading of a vector space V over K = R 
or C is a decomposition V — Vo®ViofV into the direct sum of two K-vector spaces Vq 
and Vi . The elements in (Vq U Vi) \ {0} are called homogeneous. The parity function 
1 1 : (Vo U Vi ) \ {0} — » Z2 , V G Vs- 1-^ I v| = 5 , assigns to a homogeneous element its parity. 
We write V ~ K^'* if dim^ Vq — p and dim^ Vi—q. 

A Lie superalgebra over K is a Z2 -graded K- vector space £| = 0o ® 01 equipped with 
a bilinear map [ , ] : x g — > g satisfying 

1- [0^)05'] C 0^+,' , i.e., |[X,y]| = + (mod 2) for homogeneous elements X,F. 

2. Skew symmetry: [XJ] = -(-l)'^"^'! [y^x] for homogeneous X, 7. 

3. Jacobi identity, which means that ad(X) = [X, ] : 5 — > 5 is a (super-)derivation: 

ad(X) [Y,Z] = [ad(Z)F,Z] + (-l)l^ll^l[F,ad(Z)Z] . 

Example 2.1 (qI{V)). — Let V = Vb © Vi be a Z2-graded K-vector space. There is a 
canonical Z2-grading End(y) = End(y)o © End(y ) 1 induced by the grading of V: 

End(V), := {X e End(V) | e Z2 : X{V^) c V,+^} . 

The bilinear extension of [X,Y] := XY — (— 1)I^II^IfX for homogeneous elements 
XJe End(y) to a bilinear map [, ] : End(y) x End(y) End(y) gives End(y) the 
structure of a Lie superalgebra, namely gi{V). The Jacobi identity in this case is a 
direct consequence of the associativity (XY)Z — X{YZ) and the definition of [X, 7]. 

In fact, for every Z2-graded associative algebra ^ the bracket [ , ] : ^ x ^ — > 
defined by [X, Y]=XY- (-I)I^II^IfX satisfies the Jacobi identity. 

Example 2.2 (u(y)). — Given a complex Z2-graded vector space y = yo ©yi , con- 
sider the complex Lie superalgebra End(y) = Q^iV). Equip V with a unitary structure 
so that yo -L yi . For X e End(y) we have the unique decomposition X = £]=qX^ with 
£ 0^^)* • Let <7 : qI{V) — > qI{V) be the complex anti-linear involution defined by 
o(X)s = — i^x] , where X 1— > X*^ (complex conjugation and transpose) is defined by the 
unitary structure. C7 is an automorphism of the Lie superalgebra Qi{V). Indeed, 

^([X^Y]) = I,,.,(7(X,F,0-£,,,,,(-ir'a(F,,X,) 

= -Lsj'-'^\YX-{-irx:n)^ 
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which is the same as 

= I,,,CT(X),a(y),,- J:^. ,(-l)-'a(y),,CT(X),= [a(X),CT(F)] . 

The set of fixed points Fix(a) = {X G qI{V) \ o{X) = X} is a real Lie superalgebra, 
a real form of qI{V) called the unitary Lie superalgebra u := u{V). Note that uq is the 
compact real form u{Vo) © u(Vi) of the complex Lie algebra qI{Vo) © qI{Vi). 

Example 2.3 (osp(y © V*)). — Let V = Vq © Vi be a Z2-graded K-vector space and 
put W :=V ®V* . The Z2-grading of V induces a Z2-grading W = Wq © V7i in the obvi- 
ous manner: Wq = Vq © Vq* and = © Vj* . Then consider the canonical alternating 
bilinear form A on Wq , 

A: WqxWq^K, (v + 9 , v' + (pO ^ <P'(v) - ^>(v') , 

and the canonical symmetric bilinear form 5 on Wi , 

S: WixWi^K, {v + (p,v +(p')^ (p'{v) + (p{v) . 

The orthosymplectic form of W is the non-degenerate bilinear form Q : x — > IK 
defined as the orthogonal sum Q=A + S: 

Q{wq + Wi,w'q + w\) =A(wo,Wo) {w,,w,eW,) . 

Note the exchange symmetry Q{w, w') = -{-\ ) I'^l '""'1 w) for w, w' eWqUWi. 
Given Q, define a complex linear bijection T : End(VF) End(VF) by the equation 

Q{t{X)w,w') + (-l)l^ll^le(w,Xw') = (2.1) 
for all w, w' eWqUWi. It is easy to check that x has the property 

T(xy) = -(-i)i^ii^iT(y)T(x) , 

which implies that t is an involutory automorphism of the Lie superalgebra gt(V7) 
with bracket [XJ] =XY- (-l)l^ll^lyX . Hence the subspace 05p{W) C End(W^) of 
T-fixed points is closed w.r.t. that bracket; it is called the (complex) orthosymplectic 
Lie superalgebra of W . 

Example 2.4 (Jordan- Heisenberg algebra). — Using the notation of Example 12.31 
consider the vector space W := © K and take it to be Z2-graded by VVq = W^o © IK 
and W\=W\. Define a bilinear mapping x VV^ V7 by 

[K,W] = [V7,K] =0, [W,W](ZK, [w,w] = Q{w,w) {w,w eW) . 

By the basic properties of the orthosymplectic form Q, the vector space W equipped 
with this bracket is a Lie superalgebra - the so-called Jordan-Heisenberg algebra. Note 
that W is two-step nilpotent, i.e., [W , ^ ,W]] =0. 
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2.1.1. Supertrace. — Let V = Vq © be a Z2-graded K- vector space, and recall 
the decomposition End(y) = 0^. ,Hom(V?,yf). For X G End(V), we denote hy X = 
Y^s,t^ts the corresponding decomposition of an operator. The supertrace on V is the 
linear function 

STr : End(y) ^ K , TrXoo -TrXy = £^.(-l)'TrX,, . 

(If dimV = oo, then usually the domain of definition of STr must be restricted.) 

An ad-invariant bilinear form on a Lie superalgebra g = go © 01 over K is a bilinear 
mapping B : g x g ^ K with the properties 

1. go and gi are 5-orthogonal to each other ; 

2. 5 is symmetric on go and skew on gi ; 

3. 5([X,y],Z) =5(X,[y,Z])forallX,y,ZGg. 

We will repeatedly use the following direct consequences of the definition of STr. 

Lemma 2.1. — Ifg is a Lie superalgebra in End(y), the trace form B{X, Y) = STr (XY) 
is an ad-invariant bilinear form. One has STr [X,Y] =0. 

Recalling the setting of Example [231 note that the supertrace for W = V (BV* is odd 
under the g [-automorphism r fixing 05p{W), i.e., STriy o t = — STriy . It follows that 
STriyX = for any X e 03p{W). Moreover, STriy ■ • ■X2n+i) = for any product 
of an odd number of osp-elements. 

2.1.2. Universal enveloping algebra. — Let g be a Lie superalgebra with bracket [ , ] . 
The universal enveloping algebra U(g) is defined as the quotient of the tensor algebra 
T(g) = ©^=oT"(g) by the two-sided ideal J(g) generated by all combinations 

x®y-(-i)i^ii^iy(g)X- [x,y] 

for homogeneous X,y G T^(g) = g. If U„(g) is the image of T„(g) := ©^^QT^(g) 
under the projection T(g) ^ U(g) = T(g) /J(g), the algebra U(g) is filtered by U(g) = 
U"=oU„(g). The Z2-grading g = go © gi gives rise to a Z2-grading of T(g) by 

\Xi®X2®---0Xn\ = J 1 (for homogenous X,- G g) , 

and this in turn induces a canonical Z2-grading of U(g). 

One might imagine introducing various bracket operations on T(g) and/or U(g). 
However, in view of the canonical Z2-grading, the natural bracket operation to use 
is the supercommutator, which is the bilinear map T(g) x T(g) T(g) defined by 
{a,b} := aZ? — ( — l)l''ll*IZ7a for homogeneous elements a, b G T(g). (For the time being, 
we use a different symbol { , } for better distinction from the bracket [ , ] on g .) Since 
by the definition of J(g) one has 

{T(g),J(g)} = {J(g),T(g)}cJ(g), 

the supercommutator descends to a well-defined map { , } : U(g) x U(g) — U(g). 

Lemma 2.2. — If q is a Lie superalgebra, the supercommutator { , } gives U(g) the 
structure of another Lie superalgebra in which {U„(g), U„/(g)} C U„+„'_i(g). 
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Proof. — Compatibility with the Z2-grading, skew symmetry, and Jacobi identity are 
properties of {, } that are immediate at the level of the tensor algebra T(g). They 
descend to the corresponding properties at the level of U(0) by the definition of the 
two-sided ideal J(0). Thus U(g) with the bracket { , } is a Lie superalgebra. 

To see that {U„(0), U,y(0)} is contained in U„_|_„/_i (g), notice that this property 
holds true for n = n' = \ by the defining relations =0 of U(0). Then use the 
associative law for U(g) to verify the formula 

{a,bc} = abc-{-lt\^\^\+\'%ca = {a,b}c+ {-lt^^^^b{a,c} 

for homogeneous a,b,c E U (g) . The claim now follows by induction on the degree of 
the filtration U(g) = U^^oU„(0). □ 

By definition, the supercommutator of U(0) and the bracket of g agree at the linear 
level: {X, i'} = [X,Y] for X, 7 G g . It is therefore reasonable to drop the distinction in 
notation and simply write [, ] for both of these product operations. This we now do. 

For future use, note the following variant of the preceding formula: if Yi, ... ,Yj^,X 
are any homogeneous elements of g , then 

k ^, 

[Yi---Yk,X] = £(-l)l^l^;w+i \yj\ . . .y,_i [Yi ,X] Yi+i ■ ■ -F, , (2.2) 

i=l 

which expresses the supercommutator in U(g) by the bracket in g . 

2.2. Structure of 03p{W). — For a Z2-graded K-vector space V = Vq © Vi let W = 

V (BV* = Wo(BWi as in Example 12.31 The orthogonal Lie algebra o{W\) is the Lie 
algebra of the Lie group 0(Wi) of K-linear transformations of W\ that leave the non- 
degenerate symmetric bilinear form S invariant. This means that X G End(Wi) is in 
o(V7i) if and only if 

Vw,w' G Wi : S{Xw,w') + S{w,Xw') = . 

Similarly, the symplectic Lie algebra sp(Wb) is the Lie algebra of the automorphism 
group Sp (Wb) of Wq equipped with the non-degenerate alternating bilinear form A : 

5p(Wb) = {X G End(Wb) I Vw,w' G Wq : A(Xw,w') +A{w,Xw') = 0} . 

For the next statement, recall the definition of the ortho symplectic Lie superalgebra 
osp(W) and the decomposition osp{W) = osp(W^)o © osp{W)i. 

Lemma 2.3. — As Lie algebras resp. vector spaces, 

osp(W^)o~o(iyi)©sp(W^o) , osp(W)i ~Wi®Wo* ■ 

Proof. — The first isomorphism follows directly from the definitions. For the second 
isomorphism, decompose X G 05p(V7)i as X = Xqi +Xiq where Xqi G Hom(Wi, Wq) 
and Xio G Hom( Wb , Wi ) . Then 

osp(W)i = {Xio+Xoi G End(W^)i | Vw, G W, : 5(Xiowo,wi) -fA(wo ,^01^1) = 0} . 

Since both S and A are non-degenerate, the component Xqi is determined by the com- 
ponent Xio , and one therefore has osp ( W) 1 ~ Hom(W() , ) ~ Wj ® W^* . □ 
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We now review how sp(Wo) and o{Wi) decompose for our case Ws = ®V* . For 
that purpose, if i7 is a vector space with dual vector space U*, let Sym{U,U*) and 
A\t{U, U*) denote the symmetric resp. alternating linear maps from U to U*. 

Lemma 2.4. — As vector spaces, 

( ) ^ End(yi ) © Ait( , ) © Ait(yi* , ) , 

sp(Wo) - End(yo) © Sym(yo y^)® Sym{V^,VQ) . 
Proof. — There is a canonical decomposition 

End(H^,) = End(yj © Hom(y;, yj © Hom(y, X)® End(y;) 
for ^ = 0, 1. Let ^ = 1 and write the corresponding decomposition of X G End(Wi) as 

X= A©B©C©D. 

Substituting w = v-\-(p and w' = v' + (p', the defining condition 5(Xw, w') = —S{w,Xw') 
forX G o{Wi) then transcribes to 

(P'(Av) = -(D(pO(v), (Cv)(vO = -(Cv')(v), (p'{Bcp) = -cp{Bcp'), 

for all V, v' G Vi and (p, (p' G yf. Thus D = — A^ and the maps B, C are alternating. This 
already proves the statement for the case of o{Wi). 

The situation for sp(W()) is identical but for a sign change: the symmetric form S is 
replaced by the alternating form A , and this causes the parity of B, C to be reversed. □ 

By adding up dimensions, Lemmas [2.31 and entail the following consequence. 

Corollary 2.1 . — As a Zj-graded vector space, osp(y ©y*) is isomorphic to K^'^ 
where p = do{2do + \) +di {2d\ — 1 ), q = Ad^di , and ds = dimy^ . 

There exists another way of thinking about osp(W), which will play a key role in 
the sequel. To define it and keep the sign factors consistent and transparent, we need to 
be meticulous about our ordering conventions. Hence, if v G y is a vector and (p eV* 
is a linear function, we write the value of (p on v as 

(p{v) = (v, (p) . 

Based on this notational convention, if y is a Z2-graded vector space and X G End(y ) 
is a homogeneous operator, we define the supertranspose X^^ G End(y*) of X by 

(v,x^V) := (-i)i^ii"i(Xv,(p) (vGyouyi, (pGy*) . 

This definition differs from the usual transpose by a change of sign in the case when X 
has a component in Hom(yi , Vq) . From it, it follows directly that the negative super- 
transpose gl(y) — > g[(y*), X ^ —X^^ is an isomorphism of Lie superalgebras: 

The modified notion of transpose goes hand in hand with a modified notion of what 
it means for an operator in Hom(y, y*) or Hom(y*,y) to be symmetric. Thus, define 



12 



A. HUCKLEBERRY, A. PUTTMANN AND M.R. ZIRNBAUER 



the subspace Sym(V*,y) c Hom(y*,y) to consist of the elements, say B, which are 
symmetric in the Z2-graded sense: 

V(p, (p' G Vo* U V{ : (B(p, cp') = (B(p', (p) {-1)M^'\ . (2.3) 
By the same principle, define Sym(y, V*) C Hom(y, V*) as the set of solutions C of 

Vv,v' G VqUVi : (v,Cv') = (v',Cv) {-l)\^'M+\y\+W\ . (2.4) 
To make the connection with the decomposition of Lemma [23] and [241 notice that 

Sym(V,V)nHom(V„v;) = { W_rf' ^I?; 

and similar for the corresponding intersections involving Sym(y*,y). 
Next, expressing the orthosymplectic form QofW = V®V* as 

and writing out the conditions resulting from Q{Xw,w') + (— 1)I^II^Iq(>v,Z>v') = for 
the case of X = B G Hom(y*, y) and X = C G Hom(y, V*), one sees that 

05p(H^) nHom(y,y*) = Sym(y,y*) , 05p(w^) nHom(y*,y) = Sym(y*,y) . 

This situation is summarized in the next statement. 

Lemma 2.5. — The orthosymplectic Lie superalgebra ofW = V ®V* decomposes as 

Osp(W^)= 0^-2) 0(0) g^g(+2)^ 

where :=Sym(y,y*), and q^-^^ :=Sym(y*,y), and 

g(0) := (End(y)©End(y*))nosp(W) . 

The decomposition of Lemma [23] can be regarded as a Z-grading of osp (W) . By the 
'block' structure inherited from W = V (BV* , this decomposition is compatible with 
the bracket [ , ] : 

where = Q if m + m' ^ {±2,0}. It follows that each of the three subspaces 

g(+2)^ g(-2)^ g(o) |g ^ ]^jg superalgebra, the first two with vanishing bracket. 

Lemma 2.6. — The embedding End(y) End(y) © End(y*) by A ^ A© 
projected to osp{W) is an isomorphism of Lie superalgebras QliV) Q^^^. 

Proof. — Since the negative supertranspose A 1-^ — A**' is a homomorphism of Lie 
superalgebras, so is our embedding A i-^ A© (— A^'). This map is clearly injective. To 
see that it is surjective, consider any homogeneous X = A© D G End(y) ©End(y*) 
viewed as an operator in End(V7). The condition for X to be in osp(W^) is (12.11 ). To 
get a non-trivial condition, choose (w,w') = (v, 9) or (w,w') = (9,v). The first choice 
gives 

<2(Xv, (p) + (-l)l^ll^'le(v,X(p) = (Av, (p) + (-1)1^11^1 (v, D(p) = . 
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Valid for all v G Vq U Vi and (p G V*, this implies that D = -A^'. The second choice 
leads to the same conclusion. Thus X = A© D is in osp(VF) if and only if D = — A^'. □ 

In the following subsections we will often write 05p(V7) = osp for short. 

2.2.1. Roots and root spaces. — A Cartan subalgebra of a Lie algebra go is a maximal 
commutative subalgebra f) C go such that qq (or its complexification if go is a real Lie 
algebra) has a basis consisting of eigenvectors of ad{H) for all // G P) . Recall that 
|[X,y]| = |Z| + |y| for homogeneous elements X,Y of a Lie superalgebra g. From 
the vantage point of decomposing g by eigenvectors or root spaces, it is therefore 
reasonable to call a Cartan subalgebra of go a Cartan subalgebra of g . We will see 
that X G ospY and [X,H] =0 for all // G f) C ospQ imply X = 0, i.e., there exists 
no commutative subalgebra of osp that properly contains a Cartan subalgebra. Lie 
superalgebras with this property are called of type I in [T|. 

Let us determine a Cartan subalgebra and the corresponding root space decomposi- 
tion of osp. For 5,f = 0, 1 choose bases {e^ i , . . . , e^^^j} of and associated dual bases 
{ft,i,---,ft,d,} ofVf*. Then for j = 1 , . . . , J^- and k= 1 , . . . , J, define rank-one opera- 
tors Es,j-j,k by the equation E,j.,^k{eu,i) = ^sj St^t 5u for all m = 0, 1 and Z = 1, . . . , 4 . 
These form a basis of End(y), and by Lemma [Z6l the operators 

form a basis of g*^^^ . Similarly, let bases of Hom(V*, V) and Hom(y, V*) be defined by 

Fs, j;t,k{fu,l) = ^s.j ^tM ^k,l 1 P'sJ;t,k{^u,l) = fsj St,u ^k,l i 

for index pairs in the appropriate range. Then by Lemma [231 and equations (12.3112.41) 
the subalgebras g*^^^) and gp-^ are generated by the sets of operators 

Since ospo — o(Wi) ©sp(Wo), a Cartan subalgebra of osp is the direct sum of a 
Cartan subalgebra of o{W\) and a Cartan subalgebra of sp(Wb). Letting [) be the span 
of the diagonal operators 

Hsj-=x^Zj (^ = 0,1;j = i,...,^/.), 

one has that () is a Cartan subalgebra of osp . Indeed, if {'&sj} denotes the basis of f)* 
dual to {Hsj} , inspection of the adjoint action of f) on osp gives the following result. 

Lemma 2.7. — The operators X^'J^^ are eigenvectors o/ad(//) for all H E^: 

{{■&sj-'&tk){H)X^j], m = 0, 

[{-^sj-^tkmxl^l, m = 2. 
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A root of a Lie superalgebra g is called even if its root space is in qq , it is called odd 
if its root space is in gi . We denote by Aq and Ai the set of even roots and the set of 
odd roots, respectively. For q = osp we have 

Ao = {±i»ij ± i»ik , ±% ± ^01 \j<kj< /}, Ai = {±^,j ± %}. 

2.2.2. Casimir elements. — As before, let g = go © fli be a Lie superalgebra, and let 
U(g) = U^^QU„(g) be its universal enveloping algebra. Denote the symmetric algebra 
of go by S(go) and the exterior algebra of gi by A(gi). The Poincare-Birkhoff-Witt 
theorem for Lie superalgebras states that for each n there is a bijective correspondence 

U„(g)/U,_i(g) ^£,^,^„A^(gi)®S'(go) . 

The collection of inverse maps lift to a vector-space isomorphism, 

A(gi)®S(go)^U(g), 

called the super-symmetrization mapping. In other words, given a homogeneous basis 
{ei, . . . of g, each element jc G U(g) can be uniquely represented in the form x = 
E«E;i,...,;„-^ii,....i„ ' ' ' ^in ^i^h supcr-symmctrlzed coefficients, i.e., 

^/:,...,/M,+,,...,,„ = (-l)''^'"'^'+''^/,,...,f,+M,,...,/„ (1 < / < n) . 

The isomorphism A(gi) (S> S(go) ^ U(g) gives U(g) a Z-grading (by the degree n). 

Now recall that U(g) comes with a canonical bracket operation, the supercommuta- 
tor[,]: U(g)xU(g)^U(g). An element X G U (g) is said to lie in the center of U (g) , 
and is called a Casimir element, iff [X, 7] =0 for all 7 G U(g). By the formula (|2.2I) . a 
necessary and sufficient condition for that is [X, 7] =0 for all 7 G g . 

In the case of g = osp , for every £ G N there is a Casimir element Ii of degree 2£, 
which is constructed as follows. Consider the bilinear form B : osp x osp — > K given 
by the supertrace (in some representation), B{X,Y) :— STr (X7). Recall that this form 
is ad-invariant, which is to say that 5 ( [X , 7] , Z) = 5 (X , [7, Z] ) for all X , 7, Z G g . 

Taking the supertrace in the fundamental representation of osp , the form B is non- 
degenerate, and therefore, if ei , . . . , e^/ is a homogeneous basis of osp , there is another 
homogeneous basis ei, . . . , of osp so that B{ei , ej) = dij . Note = and put 

d 

k-= £ ■■•^2fSTr(e,2,---e/j) G U(osp). (2.5) 

h,-—,hi=^ 

(Notice that, in view of the remark following Lemma [2?T1 there is no point in making 
the same construction with an odd number of factors.) 

Lemma 2.8. — For all £ & N the element Ii is Casimir, and \l£\ = 0. 

Proof. — By specializing the formula (12.21) to the present case, 

[k,X]=l^l^ (-l)l^l(l«.+i \+-Me.2^% ■ ■ ■ ei,_, [e,,,X] e^,^^ ■ ■ ■ e,,, STr ■■■.,). 
k=i 
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Now if [ei,X] = Y^jXijej then from ad-invariance, B{\ei,X\,ej) = Xij = B{ei, [X^ej]), 
one has \X,ej\ = E/^i^o - Using this relation to transfer the ad (Z) -action from to 
e,^ , and reading the formula (12.21) backwards, one obtains 

[Ie,X]=Y,ei,--- e,2£ STr ( [X , e,^, ■■■ei,]). 

Since the supertrace of any bracket vanishes, one concludes that [l£,X] = 0. 

The other statement, |/f | =0, follows from le/l = the additivity of the Z2-degree 
and the fact that STr (a) =0 for any odd element a G U (g) . □ 

We now describe a useful property enjoyed by the Casimir elements If of osp{V © V*) 
in the special case of isomorphic components Vq — Vi . Recalling the notation of ^2.2.11 

let d := Lj^oj\j ^rid d : = — Lj^ij oj • These are odd elements of osp . (The reason for 

using the symbols d will become clear later). Notice that the bracket A := [<?,<?] = 
— Y^sj^sj is in the Cartan algebra of osp. From [d,d] =2d^ = and the Jacobi 
identity one infers that 

By the same argument, [d,A] =0. One also sees that = Id. 
Now define Ff to be the following odd element of U(osp): 

d _ 

F£ = - £ ■ ei^e STr {et^, ■ ■ ■ ei^ dA) . 

Lemma 2.9. — Let osp{V Q)V*) be the orthosymplectic Lie superalgebra for a Z2- 
graded vector space V with isomorphic components Vq — ^i • Then for all i & N the 
Casimir element Ii is expressible as a bracket: If = [d,Fi\ . 

Proof. — By the same argument as in the proof of Lemma |2.8[ 

[d,Fe] = -Y, e/i ■ ■ ■ ei^f STr ( [d , e,^^ ■ ■ ■ e/i ] ^A) . 
Using the relations [d,A] =0 and A^ = Id, one has for any a G U(osp) that 

-STr([^,a]^A) =STr(5A[^,a]) = STr([5,(9]Aa) = STr(A2a) = STr(a) , 

where the second equality sign is from STr(c, [b,a]) = STr([c,Z7] a). The statement of 
the lemma now follows on setting a = e/j^ ■ ■ ■ ^/i • n 

As we shall see. Lemma [T9l has the drastic consequence that all osp-Casimir elements 
If are zero in the spinor-oscillator representation of osp(y © V*) for Vq — ^1 • 

2.3. Howe pairs in osp. — In the present context, a pair (f), f)') of subalgebras f), f)' C 
of a Lie superalgebra g is called a dual pair whenever [)' is the centralizer of f) in g 
and vice versa. In this subsection, let K = C 

Given a Z2-graded complex vector space U = UoQ)Ui we let V := i7 C^, where 
is equipped with the standard representation of GL(C^), O(C^) , or Sp(C^) , as 
the case may be. As a result, the Lie algebra t of whichever group is represented on 
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is embedded in osp{V®V*). We will now describe the dual pairs (f), in osp(H') 
for W = y © y*. These are known as dual pairs in the sense of R. Howe. 

Let us begin by recalling that for any representation p : K ^ GL(£') of a group K 
on a vector space E , the dual representation p* : K ^ GL(£'*) on the linear forms on 
E is given by {p{k)(p){x) — (p{p{k)^^x). By this token, every representation p : K ^ 
GL(C^) induces a representation pw = (Id p) x {160 p*) of K onW = V ® V*. 

Lemma 2.10. — Let p . K ^ GL(C^) be any representation of a Lie group K. If 
V = U ® for a 'L2-graded complex vector space U — Uq®Ui, the induced repre- 
sentation Pw*{^) of the Lie algebra ofK onW = V ®V* is a subalgebra o/o5p(W)o. 

Proof — The i^-action on ® (C^)* by z® C ^ p{k)z^p*{k)C preserves the 
canonical pairing z^C ^ between and (C^)*. Consequently, the A'-action 
on y (g) y * by (Id (8) p ) (8) (Id (g) p * ) preserves the canonical pairing V <^V* ^ C Since 
the orthosymplectic form Q : W xW ^ C uses nothing but that pairing, it follows that 

Q{Pw{k)w, pw{k)w') = Q{w,w') (for all w,w' e W) . 

Passing to the Lie algebra level one obtains pw^tci^) C osp(W). The operator pw{k) 
preserves the Z2-grading of W; therefore one actually has pw^ {i) C osp {W)o. □ 

Let us now assume that the complex Lie group K is defined by a non-degenerate bilin- 
ear form 5 : X ^ C in the sense that 

K = {k e GL{C^) eC^ : B{kz,kz')=B{z,z)} . 

We then have a canonical isomorphism y/ : — > (C^)* by z i-^ ), and an iso- 
morphism^ : ([/©[/*)(8)C^^ Why (m + ^)(8)zi-^ M<8)z+(p® V^(z). 

Lemma 2.11. — pw{k) =^o{Id^k)o^-^ for alike K. 

Proof. — If ueU,(peU*, and z G C^, then by the definition of ^ and Pw{k), 

pw{k)^{{u + ^)(g)z) =u(^kz+(p(S)\j/iz)k^^ . 

Since B is /^-invariant, one has i^(z)^~^ = ^f{kz), and therefore 

u®kz-\-<p®\\f{z)k~^ = u®kz + <p®\\f{kz) = '^{{ld®k){{u+<p)®z)) . 

Thuspvt^(A:)o^ = ^o(Id®A:). □ 

Let us now examine what happens to the orthosymplectic form Q on W when it is 
pulled back by the isomorphism to a bilinear form on {U ® U*) : 

+ (p) ®z, + (pO 0z) = (p'{u) xif{z'){z) (-l)l"'ll'Pl9(« ) ¥iz){z) . 

By definition, \l/{z){z') = B{z,z'), and writing B{z,z') = {-l)^B{z',z) where 5 = if 
B is symmetric and 5 = 1 if 5 is alternating, we obtain 

^*Q{{u + cp) ®z,{u+cp') ®z') = {(p'{u) - {-lf\\'P\+^(p{u'))B{z',z) . (2.6) 
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In view of this, let U denote the vector space U = Uq®Ui with the twisted Z2-grading, 
i.e. Us := Us^i {s E Z2). Moreover, notice that ^ determines an embedding 

End(t/©[/*)®End(C^) ^End(W^) , X ®k o {X ^k) o^'-\ 

whose restriction to End(i7 (BU*)0 {Id} End(W^) is an injective homomorphism. 
In the following we often write O(C^) = O^v and Sp(C^) = Sp^y for short. 

Corollary 2.2. — For K = On and K = Sp^y, the map X vj/ o (X ® Id) o ^- 1 defines 
a Lie superalgebra embedding into osp{W) of osp{U © U*) resp. osp(f/ © U*). 

Proof. — For K = 0^ the bilinear form B of is symmetric and the bilinear form 
QofW pulls back - see (|2.6I) - to the standard orthosymplectic form oiU ®U* . 

For K = Spyy, the form B is alternating. Its puUback, the orthosymplectic form of 
U (BU* twisted by the sign factor (—1)^, is restored to standard form by switching to 
the Z2-graded vector space U ®U* with the twisted Z2-grading. □ 

To go further, we need a statement concerning HomG(yi , V2), the space of G-equivariant 
homomorphisms between two modules V\ and V2 for a group G . 

Lemma 2.12. — LetXi ,^2 , i'l , ^2 be finite-dimensional vector spaces all of which are 
representation spaces for a group G. If the G-action on Xi andXi is trivial, then 

HomG(Xi ®YuX2® Y2) - Hom(Xi ,^2) © Homolri , Y2) . 

Proof. — Hom(Xi © Yi ,^2 © Y2) is canonically isomorphic to X^ © Y^ ©X2 © 12 as a 
G-representation space, with G-equivariant maps corresponding to G- invariant tensors. 
Since the G-action on X^ ©Xj is trivial, one sees that HomG(^i © Yi ,^2 © Y2) is iso- 
morphic to the tensor product of X^ 0X2 — Hom(Xi 5X2) with the space of G-invariants 
in Yj* © Y2 . The latter in turn is isomorphic to HomG(l'i , ^2) • n 

Proposition 2.1. — Writing qn = 0(C^) for g = qI, 0, sp, the following pairs are 
dual pairs in osp{W) : (0Kf^),flW)' {osp{U ®U*),On), (osp(C/ ffi C/*),sp^). 

Proof. — Here we calculate the centralizer of 1^ in osp(VK) for each of the three cases 
6 = 0[yv , , spyy and refer the reader to [iTJ for the remaining details. 

Since both V CW and V* C are ^-invariant subspaces, EndxiW) decomposes as 

Endjf(W^) =Endjf(y)©Homjf(y*,y)©Hom/f(y,y*)©Endj^(y*) . 

By Schur's lemma, EndA:(C^) — C, and therefore Lemma [2.121 implies 

Endj^(y) = End;f(t/©C^) ~ End(t/) ©End/^(C^) = End(t/) . 

By the same reasoning, End/i:(y*) = End(f/*). Applying Lemma [2.12l to the two re- 
maining summands, we obtain 

Homif (y, V*) ~ Hom([/, U*) ©Homjt(C^, C^*), 

plus the same statement where each vector space is replaced by its dual. 

If = GL(C^) = GL^, then Homjf(C^, C^*) = Homj^(C^*,C^) = {0}. Hence, 

4): End(t/)ffiEnd(t/*) ^EndGL^(H^) , X ©7 ^ (X ©Id) x (7 ©Id) , 
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is an isomorphism. This means that the centralizer of glyy 
in osp(VF) is the intersection ^>(End(t/) ©End(t/*)) nosp(V7), which can be identified 
withEnd(i7) = gl{U). Thus we have the first dual pair, (st(t/),g[yv). 

In the case of ^ = Oyy , the discussion is shortened by recalling Lemma [2.1 H and the 
^-equivariant isomorphism ^ : (i7 © U*) © W. By Schur's lemma, these imply 

EndA-(V7) ~ End(f/ © U*). From Corollary O it then follows that the intersection 
osp(V7) nEnd-KiW) is isomorphic as a Lie superalgebra to osp([/ (BU*). Passing to 
the Lie algebra level for K, we get the second dual pair, (osp([/ ®U*),On). 

Finally, if ^ = Sp^ , the situation is identical except that Corollary 12 . 21 compels us to 
switch to the Z2-twisted structure of orthosymplectic Lie superalgebra in EndA'(M^) ~ 
End{U © [/*). This gives us the third dual pair, {osp{U © f7*),sp^). □ 

2.4. Clifford- Weyl algebra q{W). — Let K = C or K = M (in this subsection the 
choice of number field again is immaterial) and recall from Example |2.4| the definition 
of the Jordan-Heisenberg Lie superalgebra W = W (B^, where = Wq © Wi is a Z2- 
graded vector space with components W^j = © and Wq = Vq © Vq. The universal 
enveloping algebra of the Jordan-Heisenberg Lie superalgebra is called the Clijford- 
Weyl algebra (or quantum algebra). We denote it by q{W) = \J{W). 

Equivalently, one defines the Clifford-Weyl algebra c{{W) as the associative algebra 
generated by V7 = V7 © K subject to the following relations for all w, w' G Wq U V7i : 

ww' — (—1)1^11^ Iw'w = Q{w,w') . 

In particular, wqWi = wi wq for all wq G Wq and wi G Wi . Reordering by this commu- 
tation relation defines an isomorphism of associative algebras q{W) ~ c(W^i) 0Xv{Wo), 
where the Clifford algebra c{Wi ) is generated by Wi © IK with the relations ww' + w'w = 
5(w, w') for w, w' eWi, and the Weyl algebra ro (Wq) is generated by Wq © IK with the 
relations ww' — w'w = A(w, w') for w, w' G Wq . 

As a universal enveloping algebra the Clifford-Weyl algebra q{W) is filtered, 

qo{W) :=Kc qi(W^) :=W©Kc ... C qn{W) . . . , 

and it inherits from the Jordan-Heisenberg algebra W a canonical Z2-grading and a 
canonical structure of Lie superalgebra by the supercommutator - see ^2.1.21 for the 
definitions. The next statement is a sharpened version of Lemma [Z2l 

Lemma 2.13. — [qn{W),qAW)] C q^+n'-iiW). 

Proof. — Lemma |231 asserts the commutation relation [U„(0), U,y (g)] C U„+„/_i(0) 
for the general case of a Lie superalgebra g with bracket [g,^] C g. For the specific 
case at hand, where the fundamental bracket [W, W] CK has zero component in W, the 
degree n + n' — I is lowered to n + n' — 2hy the very argument proving that lemma. □ 

It now follows that each of the subspaces qn(W^) for n < 2 is a Lie superalgebra. Since 
[q2(W), qi(VF)] C qi(V7), the quotient space q2(W^)/qi(V^) is also a Lie superalgebra. 
By the Poincare-Birkhoff-Witt theorem, there exists a vector-space isomorphism 

q2{W)/qi{W)^5, 
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sending q2(W^)/qi(W^) to s, the space of super-symmetrized degree-two elements in 
q2(VF). Hence q2(V^) has a direct-sum decomposition q2(V7) = qi(V7) ©s. 
If {ei} is a homogeneous basis of W, every a G s is uniquely expressed as 

a = y. Mijeiej , aij = (-l)l'^'H'^lay/ . (2.7) 

By adding and subtracting terms, 

2W = (W + (-l)l^ll'^'lw'w) + (W-(-l)l^ll"''lwV) , 

one sees that the product ww' for w,w' eW has scalar part = 5 [w, w'] = \Q{w, w') 

with respect to the decomposition q2(W) = K © V7 © s . 

Lemma 2.14. — [s,s] cs. 

Proof. — From the definition of s and [VK, VF] C K it is clear that [s, s] C IK © s . The 
statement to be proved, then, is that [a,b\ for a,b G s has zero scalar part. 

By the linearity of the supercommutator, it suffices to consider a single term of the 
sum (|2.7I) . Thus we put a = ww' + (— l)!^"!!^" ^w'w, and have 

^[a,b] = [ww',b]=w[w',b] + [w,b]w'{-l)^'''^^''^ . 

Now we compute the scalar part of the right-hand side. Using the Jacobi identity for 
the Lie superalgebra c{{W) we obtain 

[aMK=[w, [w',Z7]] + [[w,Z.],w'](-l)l^''ll^l = [[wy]M . 
The last expression vanishes because [w, w'] C K lies in the center of q{W). □ 

2.5. 05p(V7) inside q(VF). — As a subspace of q{W) which closes w.r.t. the super- 
commutator [ , ] , s is a Lie superalgebra. Now from Lemma [2.13| and the Jacobi identity 
for q{W), one sees that s C q2(VK) acts on each of the quotient spaces q«(V7) / q,j-i (W') 
for n > 1 by a I— *^ [a, ] . In particular, s acts on qi (VF) / qo(VK) = by a 1— > [a, w], which 
defines a homomorphism of Lie superalgebras 

T : s ^ gi{W) , a ^ T{a) = [a, ] . 
The mapping t is actually into 05p{W) C Indeed, for w,w' eW one has 

Q{r{a)w,w') + {-lp"^\\^\Q{w,T{a)w') = [[a, + ("1 k , 
and since [a, =0, this vanishes by the Jacobi identity. 

Lemma 2.15. — The map T : s — osp(VF) is an isomorphism of Lie superalgebras. 

Proof. — Being a homomorphism of Lie superalgebras, the linear mapping T is an 
isomorphism of such algebras if it is bijective. We first show that T is injective. So, let 
a G s be any element of the kernel of t . The equation x{a) = means that [[a, w] , w'] = 
[T(a)w, w'] vanishes for all w,w' G W. To fathom the consequences of this, let {e,} 
and {e,} be two homogeneous bases of W so that Q{ei,ej) = 5ij . Using that a E s 
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has a uniquely detemiined expansion a = Y.'^ij^i^j with supersymmetric coefficients 
aij = (— l)l^'H^>lay/, one computes 

[[a,ej],ei\ = aij + {-\)\''\\'j\aji = laij . 

Thus the condition [[a, w] , w'] =0 for all w,w' eW implies a = . Hence T is injective. 
By the Poincare-Birkhoff-Witt isomorphism 

5 - q2W/qi W ^ £,+,^2/\^(^i) ® S'(^o) , 

the dimensions of the Z2-graded vector space 5 = 5q®S\ are 

dimso = dim A^(Wi) +dimS^(Wo) , dimsi = dimWi dimWb • 

These agree with those of osp(W') as recorded in Corollary 12.11 Hence our injective 
linear map T : s ^ osp(M^) is in fact a bijection. □ 

Remark 2.1. — By the isomorphism T every representation p of s C q(V7) induces a 
representation p o t^^ of osp(W^). 

Let us conclude this subsection by writing down an explicit formula for T ^ To do 
so, let {e,} and {cj} be homogeneous bases of W with Q{ei , ej) = 5ij as before. For 
X G osp{W) notice that the coefficients aij := 1)1^^1 are supersymmetric: 

where the last equality sign uses (— l)l<^'H^yl aji = (— 1)I^'H^^'I aji = (— l)l«'ll^l+l«'l ay,-. 
The inverse map t^^ : osp(VK) ^ s is now expressed as 

T^H^) = ^2ll,^.Q{e,,Xej){-lp\+'e,ej . (2.8) 

To verify this formula, one calculates the double supercommutator [e,-, [T^^(X),ej]] 
and shows that the result is equal to [ei.Xej] = Q{ei,Xej), which is precisely what is 
required from the definition of T by [x^^{X) , Cj] = Xcj . 

2.6. Spinor-oscillator representation. — As before, starting from a Z2-graded K- 
vector space V = Vb © Vi , let the direct sum W = V ®V* be equipped with the or- 
thosymplectic form Q and denote by q(W) the Clifford- Weyl algebra of W . 
Consider now the following tensor product of exterior and symmetric algebras: 

a(y) := A(yf)®s(yo*) • 

Following R. Howe we call it the spinor-oscillatormodule of q(W). Notice that a{V) 
can be identified with the graded-commutative subalgebra in q(W^) which is generated 
by y ©K. As such, a(y) comes with a canonical Z2-grading and its space of endo- 
morphisms carries a structure of Lie superalgebra, 0[(a(y)) = End(a(y)). 

The algebra aiV) now is to become a representation space for q(V7) . Four operations 
are needed for this: the operator e(9i) : f\^{y^) A^+^(yj*) of exterior multiplica- 
tion by a linear form (pi e yf ; the operator i(vi) : A^(yj*) A^'"^(yj*) of alternating 
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contraction with a vector vi G Vi ; the operator /i((po) '■ S'(Vo*) S'+^(V'q*) of multi- 
plication with a linear function % e Vq ; and the operator 5{vo) : S'(Vq*) S'"^(V'q*) 
of taking the directional derivative by a vector vq eVq. 

The operators e and i obey the canonical anti-commutation relations (CAR), which 
is to say that £{(p) and e{(p') anti-commute, i(v) and i(v') do as well, and one has 

i(v)e((p)+e((p)i(v) = (p(v)Id;\(v;) • 

The operators /i and 5 obey the canonical commutation relations (CCR), i.e., Il{(p) 
and /i(<p') commute, so do 8{v) and 5{v'), and one has 

5{v)ii{(p)-^{(p)5{v) = (p{v)lds(v*) ■ 

Given all these operations, one defines a linear mapping q : W End(a(y)) by 

qivi + (pi +vo + (po) = i(vi)+e((pi) + 5(vo)+/i((po) (v., G V,, (p, e V*) , 

with l(vi), e((pi) operating on the first factor of the tensor product A(yj*) C?) S(yo*). and 
5{vo), /i(<Po) on the second factor. Of course the two sets £, i and /i, 5 commute with 
each other. In terms of q , the relations CAR and CCR are succinctly summarized as 

[q{w),q{w')] = Q{w,w')ld,(^y), (2.9) 

where [ , ] denotes the usual supercommutator of the Lie superalgebra gl(a{V) ) . By the 
relation (12.91 ) the linear map q extends to a representation of the Jordan-Heisenberg Lie 
superalgebra W = W (B'K, with the constants of W acting as multiples of Id^i^v) ■ 

Moreover, being a representation of W, the map q yields a representation of the 
universal enveloping algebra U(VV') = c\{W). This representation is referred to as the 
spinor-oscillator representation of c\{W). In the sequel we will be interested in the 
osp(VF) -representation induced from it by the isomorphism T^^ . 

There is a natural Z-grading a{V) = 0„,>o a'"{V) , 

a'"(v) = e,+,=,„A^(yr)®s'(yo*)- 

Note that the operators £(^1) and ll{(po) increase the Z-degree of a{V) by one, while 
the operators i(vi) and 5(vo) decrease it by one. Note also if A = (— Idy) ©Idv* is the 
osp-element introduced in S2.2.21 then a direct computation using the formula (12.81) 
shows that a"\V) is an eigenspace of the operator (^o t^^)(A) with eigenvalue m. 
Thus A G osp is represented on the spinor-oscillator module a{V) by the degree. 

2.6.1. Weight constraints. — We now specialize to the situation of V = i7 ® with 
U = Uo(BUi a Z2-graded vector space as in ^2.3[ and we require Uq and Ui to be 
isomorphic with dimension dimi7o = dimi7i = n. Recall that 

(osp(t/©t/*),o^) , {osp{U®U*),spj^) , 

are Howe dual pairs in osp(V7) which we denote by (g, t). There is a decomposition 

= 0^"^^ © 0^*^^ © 0^^^ , 0^°^ = n (End(t/) © End(t/*)) , 
0(-2) = g n Hom(t/*, U) , 0(2) = n Hom([/, U*) , 



22 



A. HUCKLEBERRY, A. PUTTMANN AND M.R. ZIRNBAUER 



in both cases. The notation highlights the fact that the operators in g^'") "-^ osp{V (BV*) 
change the degree of elements in a{V) by m. Note that the Cartan subalgebra f) of 
diagonal operators in g is contained in q^^^ but f) 7^ 0*-*^^. 

Since the Lie algebra I is defined on C^, the 6-action on a{V) preserves the degree. 
This action exponentiates to an action of the complex Lie group K on a{V). 

Proposition 2.2. — The subalgebra a(y)^ of K -invariants in aiV) is an irreducible 
module for g. The vacuum 1 G Ci{V)^ is contained in it as a cyclic vector such that 

g(-2).i=o, g(0).l = (i)c, (g(2).l)c = a(Vf . 

Proof. — This is a restatement of Theorems 8 and 9 of [|7||- □ 

Remark 2.2. — In the case of (g, t) = (osp(t/ © U*), Ojy) it matters that K = On , as 
the connected Lie group K = SOn has invariants in a{V) not contained in (g^^-*. l)c ■ 

Proposition l2.2l has immediate consequences for the weights of the g-representation on 
a{V)^. Using the notation of §I2.2.1[ let {Hsj} be a standard basis of f) and {'dsj} the 
corresponding dual basis. We now write -O-qj =: and d-ij =: ii/Zj (j = 1, . . . 

Corollary 2.3 . — The representations of 05p{U ®U*) on a{V)^^ and osp(f/ ®U*) 
on a(y)^P'v each have highest weight = ~ ^j)- Every weight of these 

representations is of the form Lj-=i(™jV6' with — y < my < y < nj. 

Proof — Recall from ^23) the embedding of osp{U®U*) and osp(C/©f7*) in osp(W), 
and from Lemma 12.151 the isomorphism T^^ : osp(VF) s where s is the Lie superal- 
gebra of super symmetrized degree-two elements in (\{W). Specializing formula (12.81) 
to the case of a Cartan algebra generator Hsj G f) C g one gets 

T-\H,j) = -{Y!!,=M,j®fa){e,^j®ea) + {-\r{es,j®ea)^^^^^ 

where [ea] is a basis of and {/„} the dual basis of (C^)*. 

Now let x^^{Hsj) G 5 act by the corresponding operator, say Hsj '■= {qo T^^){Hsj), 
in the spinor-oscillator representation ^ of s C q(V7). Application of that operator to 
the highest-weight vector 1 G C = A°(yf ) © S^{V^) C a{V)^ yields 

= iE«i(ei,7®e«)e(/i.7®/a)l = f ' 
1 = -5 ^(^oj ® ea)liifoj © A) 1 = - f . 

Altogether this means that H 1 = Xm{H) 1 where Ajv(//) = - (l)j{H)). 

From Lemma [277] the roots a corresponding to root spaces g^ C g*^^^ are of the form 

where the indices j, j' are subject to restrictions that depend on g being osp{U ©[/*) 
or osp{U © U*). From a{V)^ = Q^'^hl one then has mj < j < nj for every weight 
7= L(i"^jV6' ~ "j^;) °f g-representation on a{V)^. 
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The restriction mj > j —A^ results from A{V^) = A{Ul ® (C^)*) being isomorphic 
to A (C^)* and the vanishing of A^(C^)* = for k>N. □ 

Corollary 2.4. — For each of our two cases q = 05p{U ®U*) and q = osp{U (BU*) 
the element A = —Y^sjf^sj C g is represented on a{V)^ by the degree operator 

Proof. — Since the ^-action on a{V) preserves the degree, the subalgebra a{V)^ is 
still Z-graded by the same degree. Summing the above expressions for (^o T^^)(Hsj) 
over 5, j and using CAR and CCR to combine terms, we obtain 

n N 

(^oT-i)(A) = £ £ {^{fo.j(E)fa)d{eo,j®ea)+£{fi,j®fa)i{ei,j®ea)) , 

j=la=l 

which is in fact the operator for the degree of the Z-graded module a{V)^. □ 

2.6.2. Positive and simple roots. — We here record the systems of simple positive 
roots that we will use later (in ^4.3.5D . In the case of osp(t/ © U*) this will be 

The corresponding system of positive roots for osp{U © U*) is 

In the case of osp{U © [/*) we choose the system of simple positive roots 

(l)l-(f)2 ,...,(l)n-l- (j)n , (Pn " iV^I - Wl , ■ ■ ■ , Wn-l " Wn , 2i\j/n ■ 

The corresponding positive root system then is 

(l)j±(l)k,i\i/j±m{j <k) , 2i\j/j, (l)j±iYk{j,k= l,...,n) . 
In both cases the roots 

^j-^k ,Wj-WkU <k) , ^j-iy/kU^k = l,...,n) , 
form a system of positive roots for qI{U) ~ g^^^ C osp. 

2.6.3. Unitary structure. — We now equip the spinor-oscillator module a{V) for V = 
Vq © Vi with a unitary structure. The idea is to think of the algebra a{V) as a subset of 
ff{Vo, AVj*), the holomorphic functions Vq /\{V^). For such functions a Hermitian 
scalar product is defined via Berezin's notion of superintegration as follows. 

For present purposes, it is imperative that V be defined over M, i.e., V = Vr © C, and 
that V be re-interpreted as a real vector space V' := Vr ©/Vr with complex structure 
7 ~ i. Needless to say, this is done in a manner consistent with the Z2-grading, so that 

r = v^® vi and y; = y,,R © j y,,R ~ y„R © c = y, . 

From y, = [/, © and Ui ~ Uq we are given an isomorphism Vi^Vq. This induces 
a canonical isomorphism A(y(*) ~ A(yQ*), which gives rise to a bundle isomorphism 
Q. sending r(yQ, Ay/*), the algebra of real-analytic functions on Vq with values in 
A(y(*), to T{Vq , Ar*yQ), the complex of real-analytic differential forms on Vq . Fixing 
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some orientation of Vq , the Berezin (super-)integral for the Z2-graded vector space 
V' = Vq(B Vl is then defined as the composite map 

whenever the integral over Vq exists. Thus the Berezin integral is a two-step process: 
first the section 4> is converted into a differential form, then the form Q[4>] is integrated 
in the usual sense to produce a complex number. Of course, by the rules of integration 
of differential forms only the top-degree component of [4>] contributes to the integral. 

The subspace C V' has played no role so far, but now we use it to decompose the 
complexification V' 0C into holomorphic and anti-holomorphic parts: V' 0C = V (BV 
and determine an operation of complex conjugation V* — > V*. We also fix on V = 
Vq © Vi a Hermitian scalar product (a.k.a. unitary structure) ( , ) so that Vq J-Vi . This 
scalar product determines a parity-preserving complex anti-linear bijection c : V ^V* 
by V 1-^ cv = (v, ). Composing c with complex conjugation V* V* we get a C-linear 
isomorphism V V*, v t-^ cv. 

In this setting there is a distinguished Gaussian section 7 G ^{Vq , AVj * C) singled 
out by the conditions 

VvoG Vo,vi GVi : 5(vo)r= -ju(cv^)r, i{vi)y = -e{cn)r ■ (2-10) 

To get a close-up view of 7, let {eo,/} and {eij} be orthonormal bases of Vq resp. 
Vi , and let zj = ceoj and i^j = ceij be the corresponding coordinate functions, with 
complex conjugates Zj and l^j . Viewing l^j , as generators of A(V/* Cg)C), our section 
7 G T{Vq , AV/* (g) C) is the standard Gaussian 

7= const X e^^ji^J^J+^j^j) . 

We fix the normalization of 7 by the condition /yj, ^^[7] = 1. 

A unitary structure on the spinor-oscillator module a{V) is now defined as follows. 
Let complex conjugation V* V* be extended to an algebra anti-homomorphism 
a{V) a{V) by the convention 4>i4>2 = ^2^1 (without any sign factors). Then, if 
4>i , are any two elements of a(y), we view them as holomorphic maps Vq — > A(V'j*), 
multiply $1 with 4>2 to form 4>i4>2 G r(VQ, AV/* ® C), and define their Hermitian 
scalar product by 

(*i,^2)a(v):= /,a[75i4>2]. (2.11) 

JVq 

Let us mention in passing that (12.111) coincides with the unitary structure of a{V) 
used in the Hamiltonian formulation of quantum field theories and in the Fock space 
description of many -particle systems composed of fermions and bosons. The elements 

for mj G {0, 1} and G {0, 1, . . .} form an orthonormal set in c(V), which in physics 
is called the occupation number basis of a{V). 
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Lemma 2.16. — For all vq G Vq and vi G Vi the pairs of operators 5(vo), jU(cvo) and 
l(vi), e(cvi) in End(a(y)) obey the relations 

5(vo)' =/i(cvo) , i(vi)^ = e(cvi) , 
i.e., they are mutual adjoints with respect to the unitary structure ofa{V). 

Proof. — Let v eVq. Since 4>i G a{V) is anti-holomorphic, we have 5(v)4>i = 0. By 
the first defining property of 7 in (|2.10l) and the fact that 5 (v) is a derivation, 

7^i5(v)4>2 = 5(v) (7^14)2) +Ai(cv)7^i4>2 , 
and passing to the Hermitian scalar product by the Berezin integral we obtain 

(4>i,5(v)4>2)^(v) = / a[rWiii{cv)^2] = (m(cv)4)i,4)2)„(^) . 

By the definition of the f-operation this means that 5(v)^ = /i(cv). 

In the case of v G Vi the argument is similar but for a few sign changes. Our starting 
relation changes to 

7^ii(v)4>2= (-l)l*'li(v) (7^i4>2)+(-l)l*'le(cv)7^i4>2, 

since the operator i (v) is an anri-derivation. If v 1— v denotes the isomorphism Vi ^Vq, 
then Q o I (v) = I (v) o Q and the first term on the right-hand side Berezin-integrates to 
zero because i(v) lowers the degree in Ar*VQ . Therefore, 

{^Ul{v)^2)a(V) = I ^^[r^l£{cv)^2\ = {£{cv)^u^2) a(V) ' 

which is the statement l (v)^ = e(cv). □ 

By the Hermitian scalar product (12.111) and the corresponding L^-norm, the spinor- 
oscillator module a{V) is completed to a Hilbert space, £/v ■ A nice feature here is that, 
as an immediate consequence of the factors 1 / y^nj ! in the orthonormal basis (12.121) . 
the L^-condition (4>,4>)(j(y) < 0° implies absolute convergence of the power series for 
4> G ^/v ■ Hence ,s/v can be viewed as a subspace of ^(Vq 7 AVj*): 

In the important case of isomorphic components Vq — Vi , we may regard as the 
Hilbert space of square-integrable holomorphic differential forms on Vq . 

Note that although 5(v) and ii{(p) do not exist as operators on the Hilbert space £/y , 
they do extend to linear operators on ^{Vq , AV^) for all v eVq and cp eVq . 

2.7. Real structures. — In this subsection we define a real structure for the complex 
vector space W = V (BV* and describe, in particular, the resulting real forms of the 
(Z2-even components of the) Howe dual partners introduced above. 

Recalling the map c : V — V*, v 1— (v, ) , let 1% ~ V be the vector space 

W^ = {v + cv\veV} cv®v* = w . 
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Note that Wr can be viewed as the fixed point set Wr — Fix(C) of the involution 

C:W-^W, v + (p c"V + cv . 

By the orthogonality assumption, Wr = Wb,R © Wi^r where W^-^r = n Wr . 

The symmetric bilinear form S on W^j = © restricts to a Euclidean structure 

5: Wi^RxW'i^R^M, (v + cv,v' + cv') ^29^c(v,v') , 

whereas the alternating form A on Wq = Vq(B Vq induces a real-valued symplectic form 

CO = iA : Wb,R X Wo,R ^ M , (v + cv, v +cv') ^ 2 Jm(v,v') . 

Please be warned that, since Q = S + A fails to be real- valued on Wr , the intersection 
osp(M^) n End(WR) is not a real form of the complex Lie superalgebra osp(M^) . 

The connected classical real Lie groups associated to the bilinear forms S and CO are 

S0(V7i,r) := {g e SL(V7i,r) I Vw,w' G V^i^r : S{gw,gw') = S{w,w')} , 
Sp(Wo,r) := {g e GL(Wo,r) I Vw,w' G Wo,r : co{gw,gw') = co{w,w')} . 

They have Lie algebras denoted by o(iyi r) and sp(Wb,R). By construction we have 
osp(W^)o n End(WR) ~ o(W'lr) ©sp(Wo,r), and this in fact is a real form of the com- 
plex Lie algebra osp(W')o — o(Wi) ©sp(Wo). 

Proposition 2.3 . — The elements o/o(Wi,r) ©3P(W(),r) C osp(W^) are mapped via 
T^^ and the spinor-oscillator representation to anti-Hermitian operators in End(a(V)). 

Proof. — Let X G o(iyi,R) ©sp(Wb,R). We know from Lemma I2J5] that T^^X) is 
a super- symmetrized element of degree two in the Clifford-Weyl algebra c{{W). To 
see the explicit form of such an element, recall the definition T(a)w = . Since 
Q = S + A, and A restricts to ift) , the fundamental bracket [, ] : x V7r C given 
by [w,w'] = Q{w,w') is real- valued on Wi^r but imaginary-valued on W(),r. Therefore, 

'!^"Ho(W^i,r)) = spanR{W-w'w} {w,w' G Wi,r) , 
T"^(sp(Wb,R)) = spanR{iW -fiw'w} (w,w' G Wb,R) . 

The proposed statement = —X now follows under the assumption that the spinor- 
oscillator representation maps every w G Wr to a self-adjoint operator in End(a(y)). 
But every element w G Wr is of the form vi -|- cvi + vq + cvq and this maps to the 
operator i(vi) + e(cvi) + 5{vo) + ju(cvo), which is self-adjoint by Lemma [2?T6l □ 

Given the real structure Wr of W, we now ask how End(WR) intersects with the 
Howe pairs {o5p{U ®U*),On) and (osp(f/ © f/*),sp^,) embedded in osp(W). By the 
observation that Q restricted to Wr is not real-valued, osp([/ © U*) nEnd(WR) fails to 
be a real form of the complex Lie superalgebra osp{U © U*), and the same goes for 
osp{U © U*). Nevertheless, it is still true that the even components of these intersec- 
tions are real forms of the complex Lie algebras osp{U (BU*)o and osp{U © t/*)o • 
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The real forms of interest are best understood by expressing them via blocks with 
respect to the decomposition W = V (BV*. Since Wr = Fix(C), the complex linear 
endomorphisms of W stabilizing V^k are given by 

End(W^R) -{Xe End{W) \ X = CXC^^} . 

Writing X in block-decomposed form 

X=A©B©C©D= 

where A e End{V), B e Hom(y*, V), C G Hom(V, V*), and D e End{V*), the condition 
X = CXC^ becomes 

C = B, D = A. 
The bar here is a short-hand notation for the complex anti-linear maps 

Hom(y*,y) ^Hom(V,y*) , Bh^B:=cBc, 

End(y) ^End(y*) , A^A:=cAc"^ 

When expressed with respect to compatible bases of V and V*, these maps are just the 
standard operation of taking the complex conjugate of the matrices of A and B. 

Now, to get an understanding of the intersections Opff] End ( Wm. ) and 5p;^ fl End ( ) , 
recall the relation D = — A' for X E osp{W)o and the fact that the action of the complex 
Lie algebras = o(C^) and spyy = sp(C^) on W stabilizes the decomposition W = 
V © V*, with the implication that B = C = in both cases. Combining D = —A' with 
D = A one gets the anti-Hermitian property A = — a\ which means that Oa^ fl End(WR) 
and sp^ nEnd(WK) are compact real forms of and sp^v • 

Turning to the Howe dual partners of and sp^^, recall from ^2.31 the isomor- 
phism \j/ : ^ (C^)* and arrange for it to be an isometry, \]/^^ = of the unitary 
structures of and (C^)*. Recall also the embedding of the two Lie superalgebras 
osp{U © U*) and osp{U © f/*) into osp{W) = osp{U » © t/* © (C^)*) by 

fa b\ /a©Id b©v/-i\_M B\ 
l^c dyl ^ Vc©v/ d©Id J ~ Dj ■ 

Here the notation still means the same, i.e., a G End{U), b G Hom([/*, t/), and so on. 
Let a real structure (U ® U*)^ of U (B U* be defined in the same way as the real 

structure = (y©y*)K of w = y©y*. 

Proposition 2.4. — 05p{U ®U*)onEnd{Wu) c:^ o{{U^®Ul)u) ®sp{{Uq®U^)u). 

Proof. — The intersection is computed by transferring the conditions D = A and 
C = B to the level of osp{U © U*)o . Of course D = A just reduces to the correspond- 
ing condition d = a. Because the isometry i/A : (C^)* in the present case is 
symmetric one has Xjr^ = i//' = so the condition C = B transfers to c = b. For 
the same reason, the parity of the maps b,c is identical to that of B,C, i.e., b\^*^^J^^ 
is symmetric, b\ij*^y^ is skew, and similar for c. Hence, computing the intersection 
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osp([/©t/*)onEnd(V7R) amounts to the same as computing osp{V ®V*)onEnd{W^), 
and the statement follows from our previous discussion of the latter case. □ 

In the case of the Howe pair {osp{U ®U*),spp^) the isometry i// : ^ (C^)* is skew, 
so that 1// 1 = 1//' = — 1//. At the same time, the parity of b, c is reversed as compared 
to B, C: now the map b|[/*^(/y is skew and b\[j*^y^ is symmetric (and similar for c). 
Therefore, 

05p{U © f7*)o n End(H^i,R) ~ { (^^-^ e End(t/i © f/f) | a = -aS b - +b'} , 

which is a compact real form usp{U^ © t/j*) of sp(i7i © t/f ); and 

osp(C/©f7*)onEnd(W^o,R)^{(_'b _^^t) eEnd([/o©C/o*) |a = -aSb--b^}, 

which is a non-compact real form of o{Uq © Uq) known as 30*{Uq(BUq). 
Let us summarize this result. 

Proposition 2.5. — osp{U © f7*)o nEnd(WR) ~ uspiU^ © U*) ®so*{Uq © U^). 



3. Semigroup representation 

As before, we identify the complex Lie superalgebra g := osp(VK) with the space of 
super-symmetrized degree-two elements in q2(W), so that 

q2(W) =g©qi(W) , qi{W) = W®C. 

The adjoint representation of g on q(V7) restricts to the Lie algebra representation of 
go = o{Wi) ©5p(Wo) onW = Wi(BWq which is just the direct sum of the fundamental 
representations of o{Wi) and sp(W()). These are integrated by the fundamental repre- 
sentations of the complex Lie groups SO(Wi) and Sp(Wo) respectively. 

Since the Clifford- Weyl algebra q{W) is an associative algebra, one can ask if, given 
xEQoCq{W), the exponential series e^ makes sense. The existence of a one-parameter 
group e'^ for x E Qq would of course imply that 

— e'^we"''" =ad(x)w (weW). (3.1) 
at t=o 

Now q{W) = c{Wi) 0w{Wo). Since the Clifford algebra c{Wi) is finite-dimensional, 
the series e^ for x E o(Wi) ^ go does make immediate sense. In this way one is able 
to exponentiate the Lie algebra o{Wi) in c{Wi). The associated complex Lie group, 
which is then embedded in c(Wi), is Spin(W^i). This is a 2:1 cover of the complex 
orthogonal group SO(Wi). Its conjugation representation on Wi as in (|3.1I) realizes the 
covering map as a homomorphism Spin(Wi) SO(Wi). 

Viewing the other summand 3p(Wb) of go as being in the infinite-dimensional Weyl 
algebra rD(Wo), it is definitely not possibly to exponentiate it in such a naive way. This 
is in particular due to the fact that for most x E sp(Wo) the formal series is not 
contained in any space rD„(Wb) of the filtration of rD(W()). 
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As a first step toward remedying this situation, we consider c\{W) as a space of 
densely defined operators on the completion £/v (cf. §12.6.31) of the spinor-oscillator 
module a{V). Since all difficulties are on the Wq side, for the remainder of this chapter 
we simplify the notation by letting W :=Wo and discussing only the oscillator repre- 
sentation of rD(W'). Recall that this representation on a{V) is defined by multiplication 
for (p eV* and the directional derivative 5{v) for v eV. 

For X E w{W) there is at least no formal obstruction to the exponential series of x 
existing in End{£/v)- However, direct inspection shows that convergence cannot be 
expected unless some restrictions are imposed on x. This is done by introducing a 
notion of unitarity and an associated semigroup of contraction operators. 

3.1. The oscillator semigroup. — Here we introduce the basic semigroup in the 
complex symplectic group. Various structures are lifted to its canonical 2:1 covering. 
Actions of the real symplectic and metaplectic groups are discussed along with the role 
played by the cone of elliptic elements. 

3.1.1. Contraction semigroup: definitions, basic properties. — Letting (,) be the 
unitary structure on V which was fixed in the previous chapter, we recall the complex 
anti-linear bijection c : V V*, v t— > (v, ) . There is an induced map C : W ^ W on 
W^V®V*hy C{v + (p) =c-^(p + cv. As before, we put := Fix(C) CW. 

Since we have restricted our attention to the symplectic side, the vector spaces W 
and V7r are now equipped with the standard complex symplectic structure A and real 
symplectic form co = iA respectively. From here on in this chapter we abbreviate the 
notation by writing Sp := Sp(M^) and sp := 5p{W). Let an anti-unitary involution 
o : Sp ^ Sp be defined hy g CgC^. Its fixed point group Fix(c7) is the real form 
Sp(W'k) of main interest. We here denote it by Sp^ and let spR stand for its Lie algebra. 

Given A and C, consider the mixed-signature Hermitian structure 

which we denote by A (Cw , w') =: {w , w')s , with subscript s to distinguish it from the 
canonical Hermitian structure of V7 given by {v + cp.v' + cp') := (v, v') + (c^^(p', c^^^). 
The relation between the two is 

= , ^ = (-Idv)©Idv* . 

Note also the relation 

a{g)=CgC-'=s{g-ys (gESp). 

Now observe that the real form Sp^ is the subgroup of ( , )i-isometries in Sp : 

SPR = {,? e Sp I Vw G : {gw,gw)s = {w,w)s} . 

Then define a semigroup H(W^'^) in Sp by 

n{W') := {/i G Sp I Vw G W^, w ^ : {hw, hw), < (w, w),} . 

Note that the operation ^ i-^ of Hermitian conjugation with respect to ( , ) stabilizes 
Sp and that Sp^ is defined by the condition g^sg = s . The semigroup H(W^^') is defined 
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by h^sh < 5 , or equivalently, s — h^sh is positive definite. We will see later that H(VF'^) 
(or, rather, a 2 : 1 cover thereof) acts by contraction operators on the Hilbert space M^. 

It is immediate that H(VK^) is an open semigroup in Sp with Sp^ on its boundary. 
Furthermore, H(VK^) is stabilized by the action of Spjj x Spjj by h i-^ gihg2^. 

The map n : Sp ^ Sp, t-^ ho{h^^), will play an important role in our considera- 
tions. It is invariant under the Sp^-action by right multiplication, 7t{hg^^) = 7t{h), and 
is equivariant with respect to the action defined by left multiplication on its domain of 
definition and conjugation on its image space, 7r{gh) = gTz{h)g^^ . Direct calculation 
shows that in fact the ;r-fibers are exactly the orbits of the Spj^-action by right multi- 
plication. Observe that \i h = exp(iX) for X G spi^, then o{h) = h^^ and n{h) = h^. 
In particular, if t is a Cartan subalgebra of sp which is defined over R, then 7r|exp(itR) 
is just the squaring map 1 1-^ t^. 

3.1.2. Actions ofSp^ . — We now fix a Cartan subalgebra t having the property that 
Tr = exp(tR) is contained in the unitary maximal compact subgroup defined by ( , ) 
of Sp(Wr). This means that T acts diagonally on the decomposition W = V (BV* 
and there is a (unique up to order) orthogonal decomposition V = Ei® ■ ■ - (BEj into 
one-dimensional subspaces so that if Fj := c{Ej), then T acts via characters Xj on the 
vector spaces := Ej®Fj by t{ejjj) = {Xj{t)ej ,Xj{ty^fj)■ 
ln other words, we may choose {ej}j=i,...,rf to be an orthonormal basis of V and 
equip V* with the dual basis so that the elements t eT are in diagonal form: 

? = diag(Ai,...,A^,Af\...,A7i) , ^j = Xj{t) • 

Observe that, conversely, the elements of Sp that stabilize the decomposition W = 
Pi® . ■ .(B Pd and act diagonally in the above sense, are exactly the elements of T. 
Moreover, exp(itR) is the subgroup of elements t eT with XjiO ^ ^+ J - Note 

that the complex symplectic planes Pj are A-orthogonal and defined over M. 

We now wish to analyze H(W^''') via the map n : h ho{h^^). However, for a 
technical reason related to the proof of Proposition 13.11 below, we must begin with the 
opposite map, 7t' : o{hr^)h. Thus let M := :;r'(H(W^')) and write k' : H(V7^)-*M. 
The toral semigroup r+ := exp(itR) fl H(VF'*) consists of those elements t E exp(itR) 
that act as contractions on V* , i.e., < Xj{t)^^ < ^ for all j . The restriction tz'\t+ = 
Tt\Tj^ is, as indicated above, the squaring map t ^ t^; in particular we have C M and 
the set {gtg^^ \tET+,gE Sp^} is likewise contained in M. 

In the sequel, we will often encounter the action of Sp^ on and M by conjugation. 
We therefore denote this action by a special name, Int(g) t := gtg^^. 

Proposition 3.1. — M = Int(SpR)r+. 

Proof. — For g E Sp one has o{g^^) = Cg^^C^^ = sg^s . Hence if M 9 m = o{h^^)h 
with h E H(VK'^), then m = sh^sh. Consequently, {w,mw)s = {hw,hw)s < {w,w)s for 
di\\wEW \ {0}. In particular, {w,mw)s E M and if w 7^ is an m-eigenvector with 
eigenvalue A, it follows that /I G M and A (w, w)s < (w, w)s 7^ . 

Now we have ChC^^ = o{h) and hence CmC^^ = m^^ . As a result, if w 7^ is an m- 
eigenvector with eigenvalue A, then so is Cw with eigenvalue A^^ Since CsC^ = —s. 
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the product of {w,w)s with {Cw,Cw)s is always negative. If (w, w)^. > it follows that 
A < 1 and A"^ > 1 ; if {Cw, Cw)s > then A"^ < 1 and A > 1 . In both cases < A 7^ 1 . 

Since m does indeed have at least one eigenvector, we have constructed a complex 
2-plane Qi as the span of the linearly independent vectors w and Cw. The plane Qi 
is defined over M and, because 7^ {w,w)s = A(Cw, w), it is A-nondegenerate. Its 
A-orthogonal complement Qj^ is therefore also nondegenerate and defined over M. 

The transformation m G Sp stabilizes the decomposition W = Qi (B ■ Hence, 
proceeding by induction we obtain an A-orthogonal decomposition W = Qi® . . .®Qd- 
Since the Qj are m-invariant symplectic planes defined over M, there exists g E Spjj 
so that t := gmg^^ stabilizes the above T-invariant decomposition W = Pi® ■ ■ - (BPd- 
Exchanging w with Cw if necessary, we may assume that t acts diagonally on Pj = 
Ej © Fj by {ej , fj) ^ (A; ej , Ar^/y) vvith A^- > 1 . In other words, t eT+. □ 

If we let 

SprT+Spr := {gitg2^ I gug2 eSp^,te r+} , 

then we now have the following analog of the ^A^-decomposition. 

Corollary 3.1. — The semigroup H(VF^') decomposes as HiW^') — Spi^r+Spj^. In par- 
ticular, H(VK'^) is connected. 

Proof. — By definition, H(V7^) = Vm). and from Proposition l3.1 l one has HfVK^') = 
k'^ (Int(SpK)r+). Now the map 7z'\tj^ : ^ T^, t ^ t'^ surjective. Therefore 
;r' \r+) = Spr7+ , which is to say that each point in the fiber of Tt' over t eT-^ lies in 
the orbit of G r+ generated by left multiplication with Spj^ . On the other hand, by 
the property gK'{h)g^^ = n'{hg^^) of Sp^-equivariance we have 

Int(SpR)r+ = Int(SpR);r'(;r'-\r+)) = ;r'(;r'-^(r+)SpR) 

and hence H(W^) = n'-\\ni{S^^)T+) = = Sp^r+SpK. 

Because Sp^ and r+ are connected, so is H(VF'') = Sp^r+Spu . □ 

It is clear that M = Int(Spij)r+ C H(VF'*'). Furthermore, since both and Sp^ are 
invariant under the operation of Hermitian conjugation h^h^ and under the involution 
h ^ shs, we have the following consequences. 

Corollary 3.2. — H(W'^) is invariant under h\-^ and also under h t— > shs. In par- 
ticular, ll{W^) is stabilized by the map h ^ o{h^^) = sh^s. 

Remark 3.1. — Letting h' := o{hy^ one has 7t\h) = o{hy^h = h'o{h'y^ = n{h') 
and hence M = ;r'(H(W^-')) = ;r(H(W^')). The stability of li{W') under h ^ (7{h)-^ 
was not immediate from our definition of H(VF^), which is why we have been working 
from the viewpoint of H(VF'') = n'^ (M) so far. Now that we have it, we may regard 
H(V7'^) as the total space of an Spj^-principal bundle n : H(W'') M. We are going to 
see in Corollary [33] that this principal bundle is trivial. 
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Next observe that, since o{m) = rrT^ form = o{h)^^h = h'o{h')^^ G M, the maps 
TZ : M ^ M and n' : M ^ M coincide and are just the square m\-^ m^. Thus the claim 
that the elements of M have a unique square root in M can be formulated as follows. 

Proposition 3.2. — The squaring map n = k' : M ^ M is bijective. 

Proof. — Recall from Proposition 13. 1 I that every m E M is diagonalizable in the sense 
that M = Int(Spi^)r+ . Since n : r+ ^ r+ is surjective, the surjectivity of TZ : M ^ M 
is immediate. For the injectivity of n we note that the m-eigenspace with eigenvalue 
A is contained in the m^-eigenspace with eigenvalue X^. The result then follows from 
the fact that all eigenvalues of m are positive real numbers. □ 

Corollary 3.3. — Each of the two Sp^-equivariant maps Sp^ x M ^ HiW'^) defined 
by {g, m) I— s> gm and by {g, m) mg^^, is a bijection. 

Proof. — Consider the map {g, m) ^ gm . Surjectivity is evident from Corollary 13.11 
and M = Int(Spij)r+ . For the injectivity it suffices to prove that if m\,m2 E M and 
g E Spft with gmi = m2, then mi = m2. But this follows directly from 7r'{mi) = 
n'{gmi) = n'{m2) and the fact that n'\M is the bijective squaring map. 

The proof for the map (g,m) t-^ mg^^ is similar, with % replacing %' . □ 

3.1.3. Cone realization of M. — Let us look more carefully at M as a geometric 
object. First, as we have seen, the elements m of M satisfy the condition m = o{m^^). 
We regard i// : H(VK^') \1{W^) , h ^ a{h^^), as an anti-holomorphic involution and 
reformulate this condition as M C Fix(i//). In the present section we are going to 
show that M is a closed, connected, real-analytic submanifold of H(V7'^) which locally 
agrees with Fix(i//). This implies in particular that M is totally real in H(VK'^) with 
dim^M = dimcH(M^^). We will also show that the exponential map identifies M with 
a precisely defined open cone in ispR . We begin with the following statement. 

Lemma 3.1. — The image M ofn is closed as a subset of\l{W^). 

Proof. — Let /z G cl(M) C H(l¥'*). By the definition of M, we still have ho{h)^^ =: 
m E M . If /z„ is any sequence from M with h„ h, then hnO{hn)^^ — > m. But m has 
a unique square root ^/m E M and /?„ = o{hn)^^ \fm. Hence h = i/m EM . □ 

Remark 3.2. — M of course fails to be closed as a subset of Sp . For example, g = Id 
is in the closure of M C Sp but is not in M . 

Lemma 3.2. — The exponential map exp : 5p — > Sp has maximal rank along t+ . 

Proof. — We are going to use the fact that the squaring map 5 : Sp ^ Sp, g t-^ 
is a local diffeomorphism of Sp at any point t E T^. To show this, we compute the 
differential of 5 at ? and obtain 

D,S = dLf2o{ldsp + Ad{t^^))odL^-i , 

where dLg denotes the differential of the left translation Lg : Sp — > Sp, ^ ggi. 
The middle map Idgp + Ad{t^^) : sp sp is regular because all of the eigenvalues of 
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t eT^ are positive real numbers. Since dL^-i : TfSp sp and dL^i : sp Tj2Sp are 
isomorphisms, it follows that DtS : TfSp T^iSp is an isomorphism. 

Turning to the proof of the lemma, given G t+ we now choose n e N so that 2~'^^ 
is in a neighborhood of G sp where exp is a diffeomorphism. It follows that for U a 
sufficiently small neighborhood of ^ , the exponential map expressed as 

[/ 9 77 ^ l-^ri ^ exp(2""77) ^ (exp(2""77))2" = exp(77) 

is a diffeomorphism of U onto its image. □ 

Now recall M = Int(SpR)r-f and consider the cone 

'^:=Ad(SpK)t+Ci5pR. 

It follows from the equivariance of exp, i.e., exp{Ad{g)^) = Int(^) exp((^), that exp : 
^ Int(Spij)r+ = M is surjective. Furthermore, exp|t^ : t+ ^ r+ is injective and 
for every G t+ the isotropy groups of the Sp^-actions at ^ and exp((^) are the same. 
Therefore exp : ^ — > M is also injective. 

In fact, much stronger regularity holds. For the statement of this result we recall 
the anti-holomorphic involution i// : H(V7^) ll{W^) defined by h\-^ ^l^^) let 
¥ix(xj/)^ denote the connected component of Fix(i/A) that contains M. 

Proposition 3.3. — The image M C H(V7'^) of n : h ho{h^^) is the closed, con- 
nected, totally real submanifold¥\x{\if)^, which is half-dimensional in the sense that 
dim^M = dimcH(V7'*'). The set ^ = Ad(Sp|j)t-|-, which is an open positive cone in 
ispR , is in bijection with M by the real-analytic diffeomorphism exp : "io ^ M. 

Proof. — Lemma [321 implies that t+ possesses an open neighborhood U in ispR so 
that exp|(/ is everywhere of maximal rank. Because r+ lies in H(VK^) and H(VF'^') is 
open in Sp, by choosing U small enough we may assume that exp(^t/) C H(W^'^') and 
therefore that exp(t/) C M = exp(^). Since exp is a local diffeomorphism on U, we 
may also assume that U = Ad(SpR)t+ , and it then follows that ^ = Ad(SpR)f/. 
In particular, this shows that ^ is open in isp^ . In summary, 

^ = Ad(SpR)[/ ^ Int(SpR) exp([/) =Mc Fix(v/)° . 

By the equivariance of exp , we also know that it is everywhere of maximal rank on ^ . 

Now Xjf is an anti-holomorphic involution. Therefore, Fix(yA)° is a totally real, half- 
dimensional closed submanifold of H(VK^), and since ^ is open in ispR , we also know 
that dimc^ = dimRFix(i//)^. The maximal rank property of exp then implies that 
M = im(exp : ^ — > Fix(i//)*^) is open in Fix(i//)^. In Lemma [3711 it was shown that M 
is closed in H(VF'^). Thus it is open and closed in the connected manifold Fix(i//)^, and 
consequently exp : ^ ^ M = Fix(i//)^ is a local diffeomorphism of manifolds. Since 
we already know that exp : ^ ^ M is bijective, the desired result follows. □ 

Corollary 3.4. — The two identifications Sp^ x M — HlW) defined by {g,m) 1— gm 
and {g, m) mg^ ^ are real-analytic diffeomorphisms. The fundamental group of 
}i{W^) is isomorphic to ;ri(SpR) ^ Z. 
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Proof. — The first statement is proved by explicitly constructing a smooth inverse to 
each of the two maps. For this let gW — mg^^ = h E li{W^) and note that m = n{h) 
and m' = a/ 7t'{h). Since the square root is a smooth map on M, a smooth inverse in 
the two cases is defined by 

h^{h^/n'{h) '\y/n'{h)) , resp. {h-^ ^n{J^),^/n{h)) . 

The second statement follows from ^ ^ M by exp and the fact that Spj^ is a product 
of a cell and a maximal compact subgroup K . We choose K to be the unitary group 
U = U(y, ( , )) acting diagonally onW = V ®V* and recall that ;ri (U) ~ Z . □ 

3.2. Oscillator semigroup and metaplectic group. — Recall that we are concerned 
with the Lie algebra representation of 5pR C sp which is defined by the identification of 
sp with the set of symmetrized elements of degree two in the Weyl algebra )X){W) and 
the representation of )X){W) on a{V). In ^3 .41 we construct the oscillator representation 
of the metaplectic group Mp, a 2:1 cover of Spjj, which integrates this Lie algebra 
representation. Observe that since Tli (Sp^) ^ Z and Z has only one subgroup of index 
two, there is a unique such covering t : Mp Spjj . The method of construction [|8l 
we use first yields a representation of the 2: 1 covering space H( W'^) of H( W'^) and then 
realizes the oscillator representation of Mp by taking limits that correspond to going to 
Spij in the boundary of H(VK'^). This representation of the oscillator semigroup H(VK'^) 
is for our purposes at least as important as the representation of Mp . 

The goal of the present section is to lift all essential structures on H(VF'*) to H(W^'*). 

3.2.1. Lifting the semigroup. — We begin by recalling a few basic facts about cov- 
ering spaces. If G is a connected Lie group, its universal covering space U carries a 
canonical group structure: an element u eU in the fiber over ^ G G is a homotopy class 
u = [ttg] of paths ttg : [0, 1] ^ G connecting g with the neutral element e E G ; and an 
associative product U x U U , (mi,M2) ^ UiU2, is defined by taking miM2 to be the 
unique homotopy class which is given by pointwise multiplication of any two paths 
representing the homotopy classes mi,M2- The fundamental group 7ri(G) = ;ri(G, e) 
acts on U by monodromy, i.e., if [ttg] = u E U and [c] = y E 7ri(G), then one sets 
7(m) ■.= [ag*c] eU where ttg * c is the path from gtoe which is obtained by compos- 
ing the path Ug with the loop c based at e . This ni (G)-action satisfies the compatibility 
condition 7i(mi)'}^(m2) = (7i')^)(miW2) and in that sense is central. 

The situation for our semigroup H(VF'') is analogous except for the minor compli- 
cation that the distinguished point e = Id does not lie in H(M^'^) but lies in the closure 
of H(W''^). Hence, by the same principles, the universal cover U of H(V7'^) comes with 
a product operation and there is a central action of ;ri(H(VK^)) on U. Moreover, the 
product U X U U still is associative. To see this, first notice that the subsemigroup 
C H(V7'^) is simply connected and as such is canonically embedded in U. Then for 
Mi,M2,M3 £ U observe that mi(m2"3) = Yiininijus) where yG ni{li{W^)) could theo- 
retically depend on the uj . However, any such dependence has to be continuous and 
the fundamental group is discrete, so in fact y is independent of the uj and, since y is 
the identity when the uj are in r+ (lifted to U), the associativity follows. 
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Let now F ~ 2Z denote the subgroup of index two in ni (H(l¥ ^ )) ~ Z and consider 
H(W*) := U /r, which is our object of interest. Since the F-action on U is central, i.e., 

7i(mi)72(m2) = (7i72)(wiW2) for all 71, 72 G T and u\,U2& U, the product U xU 
descends to a product U /T x U /T ^ U /T . Thus U /T = H(V7^) is a semigroup, and 
the situation at hand is summarized by the following statement. 

Proposition 3.4. — The 2:1 covering : U /T = H(W) H(W*), [tt/,] T^h, is a 
homomorphism of semigroups. 

3.2.2. Actions of the metaplectic group. — Recall that we have two 2:1 coverings: a 
homomorphism of groups T : Mp Sp^ , along with a homomorphism of semigroups 
Th '■ li{W^) H(1V'*). Now, a pair of elements (g'.g) E Sp^ x Spji determines a 
transformation h g'hg^ ^ of H(1V'* ) , and by the homotopy lifting property of covering 
maps a corresponding action of Mp x Mp on H(V7'* ) is obtained as follows. 

Consider the canonical mapping Mp x M — > Sp^ x M given by T . By the real-ana- 
lytic diffeomorphism Spg xM ^ H(W*), {g,m) 1— > gm, this map can be regarded as 
a 2:1 covering of H(iy ''), and since any two 2:1 coverings are isomorphic we get an 
identification of the covering space H(VF''') with Mp x M . Moreover, the action of the 
group Mp on itself by left translations induces on Mp x M ~ H(V7^) an Mp-action 
which, by construction, satisfies the relation 

XH{g-h) = x{g)xH{h) {geM^.he n{w')) . 

This can be viewed as a statement of Mp-equivariance of the covering map Th ■ 

Now, we have another real-analytic diffeomorphism Sp^ x M — > H(V7'') by {g, m) 1— > 
mg~^, which transfers left translation in Sp]^ to right multiplication on H(W), and 
by using it we can repeat the above construction. The result is another identification 
H(W'') ~ Mp x M and another Mp-action on H(V7'^). Altogether we then have two 
actions of Mp on H(W^). The essence of the next statement is that they commute. 

Proposition 3.5. — There is a real-analytic action (gi,g2) ^ (81^82) ■ h of Mp x Mp 
on H(W*) such that the covering Xr : H(W*) H(W*) is (Mp x Mp)-equivariant: 

TH((gl,g2) = T(gl)TH(/j)T(^2)~^ • 

Proof. — By construction, the stated equivariance property of Xh holds for each of the 
two actions of Mp separately. It then follows that it holds for all (^1,^2) £ Mp x Mp 
if the two actions commute. But by T//((gi5 • h) = x{gi)xH{h) and T//((e,g2) • h) = 
XH{h)x{g2)~^ the commutator 

8 ■= Ube)(e,g2)(gl,e)~^(e,g2)~^ 

acts trivially on H(V7^) by Xh, i.e., Xnig ■ h) = Xnih). Therefore g can be regarded as 
being in the covering group T^(Id) = Z2 of the covering x : Mp — > Spj^. Since we 
can connect both ^1 and g2 to the identity e E Mp by a continuous curve, it follows 
from the discreteness of Z2 that g e Mp x Mp acts trivially on H(W'*). □ 
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Notice that since the submanifold M C H(W^^) is simply connected, there exists a can- 
onical lifting of M (which we still denote by M) to the cover H(VF'*); this is the unique 
lifting by which r+ C M is embedded as a subsemigroup in H(W^*). Proposition 13.51 
then allows us to write H(W''^) = Mp.M.Mp. 

3.2.3. Lifting involutions. — Let us now turn to the issue of lifting the various in- 
volutions at hand. As a first remark, we observe that any Lie group automorphism 
(p : SpR Spg uniquely lifts to a Lie group automorphism (p of the universal cov- 
ering group Spg , and the latter induces an automorphism of the fundamental group 

;ri(Spi^) ~ Z viewed as a subgroup of the center of Sp^. Now Aut(;ri(Spij)) ~ 
Aut(Z) ~ Z2 and both elements of this automorphism group stabilize the subgroup 
r ~ 2Z in ;ri(SpR). Therefore ^ induces an automorphism of Mp = Sp^/r. 

Since the operation h\-^ h^^ canonically lifts from Sp^ to Mp and h 1— *• {h^^Y is a 
Lie group automorphism of Sp^, it follows that Hermitian conjugation has a 

natural lift to Mp . The same goes for the Lie group automorphism h 1— > shs of Spi^ . 

Proposition 3.6. — Hermitian conjugation h\-^ and the involution h shs lift to 
unique maps with the property that they stabilize the lifted manifold M. In particular, 
the basic anti-holomorphic map Xjf : H(VK'^) H(V7'^), h t-^ o(h^^) = sh^s lifts to an 
anti-holomorphic map \j/ : H(VF'^) H(VF'^) which is the identity on M andMp x Mp- 
equivariant in that \lf{gixg2^) = g2^{x)g^^ for all gi,g2 G Mp and x G H(V7'^). 

Proof. — Recall that the simply connected space M C H(VF'') has a canonical lifting 
(still denoted by M) to H(V7^) . Since all of our involutions stabilize M as a submanifold 
of H(M^^), they are canonically defined on the lifted manifold M . In particular, the 
involution i// on M is the identity map, and therefore so is the lifted involution i//. 

Note furthermore that the involution defined by h 1— > shs is holomorphic on H(M^'^) 
and that the other two are anti-holomorphic. Now H(V7^) is connected and the lifted 
version of M is a totally real submanifold of H with dim^M = dimcH(VF'^'). In 
such a situation the identity principle of complex analysis implies that there exists at 
most one extension (holomorphic or anti-holomorphic) of an involution from M to 
H(Vl^'^). Therefore, it is enough to prove the existence of extensions. 

Since h E H(VF^') is uniquely representable as h = gm with g E Mp and m E M, the 
involution h\-^ h^ is extended by gm t-^ {gmY = m^gK Similarly, h t-^ shs extends by 
gm 1-^ {sgs){sms), and h t-^ sh'^s does so by the composition of the other two. 

The equivariance property of \j/ follows from the fact that g sg^s on Mp coincides 
with the operation of taking the inverse, g ^ g~^. □ 

3.3. Oscillator semigroup representation. — Here we construct the fundamental 
representation of the semigroup H(M^'^) on the Hilbert space jz/y, which in the present 
context we call Fock space. Our approach is parallel to that of Howe [8J: the Fock 
space we use is related to the L^-space of Howe's work by the Bargmann transform [6]. 
(Using the language of physics, one would say that Howe works with the position wave 
function while our treatment relies on the phase space wave function.) In particular. 
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following Howe we take advantage of a realization of H(W^^) as the complement of a 
certain determinantal variety in the Siegel upper half plane. 

3.3.1. Cayley transformation. — Let us begin with some background information on 
the Cayley transformation, which is defined to be the meromorphic mapping 

C : End(W') ^ End(W') , g ^ . 

Idw -g 

If g G Sp , then from A(gw, gw') = A(w, w') we have 

A((Idiy +g)w,{ldw-g)w') +A{{ldw-g)w,{ldw +g)w') = 

for all w,w' G W. By assuming that (Idiy — g) is invertible and then replacing w and 
w' by {ld\Y — g)^^w resp. {ld\Y — g)^^'w', we see that C maps the complement of the 
determinantal variety {g G Sp | Det(Idiv — s) =0} into sp . 
The inverse of the Cayley transformation is given by 

g = C-'{X) = ^^^. 
^ ^ ' X + ldw 

Reversing the above argument, one shows that if {X + Idiy) is invertible and X G sp , 
then C"i(X) G Sp. Moreover, by the relation X + Idw = 2{ldw - gY'^ for C(g) = X, 
if \dw — g is regular, then so is X + Idiy , and vice versa. Thus if we introduce the sets 

Dsp := {g G Sp I Det(Idiy -g) = 0} , D^p := {X G sp | Det(X + Idiy) = 0} , 

the following is immediate. 

Proposition 3. 7. — The Cayley transformation defines a bi-holomorphic map 

C: Sp\Dsp^sp\Dsp. 

Now we consider the restriction of C to the semigroup H(W'^). Letting t be the 
Hermitian conjugation of the previous section, denote by IKe(X) = ^(X +X^) the real 
part of an operator X G End(W) and define the associated Siegel upper half space 6 
to be the subset of elements X G End(iy) which are symmetric with respect to the 
canonical symmetric bilinear form S onW = V ®V* with 9^c(X) > 0. Notice the 
relations S{w,w') =A{w,sw') ?LndA{sw,sw') = —A{w,w'), from which it is seen thatX 
is symmetric if and only if 5X G sp . Define Dq := {X G 6 | Det(5X + Idiy) = 0}, let 

C/:=6\D6, 

and define a slightly modified Cayley transformation by 

\dw+g 

a{g) -^s- . 

Idiv -g 

Translating Proposition 13. 7[ it follows that a defines a bi-holomorphic map from Sp \ 
Z)sp onto the set of 5-symmetric operators with Dq removed. 

Proposition 3.8. — The modified Cayley transformation a : Sp\Dsp ^ End(M^) gzven 
by gy-^ s {Idw + g) (Idiv — g) ^ restricts to a bi-holomorphic map 

a : H(W^-) ^ ■ 
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This result is an immediate consequence of the following identity. 
Lemma 3.3. — For g E Sp \Dsp let a{g) =X and define Y := {sX + ld\Y)^^. Then 

^{s-g'^sg) = YHx+X'^)Y. 
In particular, one has the following equivalence: 

(9^c(X) > and Dct{sX + Idiv) ^ O) ^ s- g^sg > . 

Proof. — It is convenient to rewrite s — g^sg as 

s-g'^sg = ^{Idw -g^)s{ldw +g) + jildw +g'')s{ldw -g) • 

Using a{g) =X one directly computes that 

\{ldw-g) = {sX + ldwy^ and ^{Idw +g) = {sX + ldwy^sX . 

The desired identity follows by inserting these relations in the previous equation. □ 

Remark 3.3. — The modified Cay ley transformation intertwines the anti-holomorphic 
involution \j/ : h^-^ sh^s with the operation of taking the Hermitian conjugated t-^ X'^: 

a{\if{h)) = a{h)^ . 

Since C,f is obviously stable under Hermitian conjugation, this is another proof of the 
stability of H(W^'') under the involution i//; cf. Corollary 13.21 

2.3.2. Construction of the semigroup representation. — Let us now turn to the main 
goal of this section. Recall that we have a Lie algebra representation of sp on a(y) = 
S(y*) which is defined by its canonical embedding in X02{W). We shall now construct 
the corresponding representation of the semigroup H(V7^) on the Fock space s^y. 

It will be seen later that the character of this representation on the lifted toral semi- 
group T-f is Det^3(5 — sh). This extends to M = Int(Mp)r+ by the invariance of the 
character with respect to the conjugation action of Mp . Since H(VF'') is connected and 
M is totally real of maximal dimension in H(V7^), the identity principle then implies 
that if a semigroup representation of H(VK^) can be constructed with a holomorphic 

character, this character must be given by the square root function h ^ Det^^ {s — sh) . 

There is no difficulty discussing the square root on the simply connected submani- 
fold M. However, in order to make sense of the square root function on the full semi- 
group, we must lift all considerations to H(VF^). For convenience of notation, given 
h G H(VF'') we let a/, := a{h), and for x G H(V7'*) we simply write = ^(T/f W) where 
Xh '■ H(V7^) — > H(VF'^) is the canonical covering map. Then we put 

f{h) ■.= Det{ah + s) =Det{2s{ldw - hy'^) , 

and wish to define : H(VK'^) — > C to be the square root of / which agrees with the 
positive square root on . (Here we regard as being in H(VF'*) by its canonical 
lifting as a subsemigroup of H(V7'^) as in the previous section). This is possible be- 
cause (j) is naturally defined on {((^, T]) G H(V7'') x C | f{^) = t]^} which is itself a 2:1 
cover of H(M^^). Since up to equivariant equivalence there is only one such covering. 
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namely H(M^^) H(W*), it follows that we may define (j) on H(W*) as desired. For 
the construction of the oscillator representation it is useful to observe that (j) can be 

extended to a slightly larger space. This extension is constructed as follows. 

Regard the complex symplectic group Sp as the total space of an Sp^-principal 
bundle K : Sp ^ ^(Sp), g i— > g(y{g^^)- Recall that the restricted map k : M ^ M is a 
diffeomorphism, and that M contains the neutral element Id e Sp in its boundary. We 
choose a small ball B centered at Id in the base 7r(Sp), and using the fact that M can 
be identified with a cone in isp^ we observe that A := B U M C 7r(Sp) is contractible. 
Now U := n~^{A) is diffeomorphic to a product Spj^ x A and thus comes with a 2:1 
covering U ^ U defined by T : Mp — > Sp^. The covering space U contains H(V7'^), 
and is invariant under the Mp-action by right multiplication. By construction it also 
contains the metaplectic group Mp, which covers the group Sp^ in Sp. 

Recall the definition of the determinant variety Dsp = G Sp | Det(Idiv — g) =0}. 
Let Dsp denote the set of points in U which lie over Dsp DU hy the covering U ^U. 

Proposition 3.9. — There is a unique continuous extension of (j) from H(W*) to its 
closure in U so that <j)^ agrees with the lift of f from U. The intersection ofD^p with 

any Mp-orbit in U is nowhere dense in that orbit and the restriction of the extended 
function (j> to the complement of that intersection is real-analytic. 

Remark 3.4. — Before beginning the proof, it should be clarified that at the points of 
the lifted determinant variety, i.e., where the lifted square root of the function f{g) = 
Det(25 {Idw — g)~^) has a pole, continuity of the extension means that the reciprocal of 
extends to a continuous function which vanishes on that set. 

Proof. — The intersection of Dsp with any Spj^-orbit in U is nowhere dense in that 
orbit; therefore the same holds for the intersection of Dsp with any Mp-orbit in U . 

Let X e U\Dsp be a point of the boundary of H(VK^). Choose a local contractible 
section L C ?7 of ?7 — > A with x e L and a neighborhood A of the identity in Mp so 
that the map A x L — > ?7, (g,*) i— > sg~^, realizes A x E as a neighborhood V of x 
which has empty intersection with D^p . By construction V fl H(W*) is connected and 
is itself simply connected. Thus the desired unique extension of (j) exists on V. At x 
this extension is simply defined by taking limits of ^ along arbitrary sequences {x„} 
from H(W'^). Thus the extended function (still called 0) is well-defined on the closure 
of H(V7'') and is real-analytic on the complement of Dsp in every Mp-orbit in that 
closure. It extends as a continuous function on the full closure of H(V7*) by defining it 
to be identically oo on Dsp , i.e., its reciprocal vanishes identically at these points. □ 

Now let us proceed with our main objective of defining the semigroup representation 
on n{W'). Recall the involution i// : U{W') U{W'), h ^ a(/i) \ and its lift \j/ to 
H(W'*). The following will be of use at several points in the sequel. 

Proposition 3.10. — ^o\j/— (p. 
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Proof. — By direct calculation, /o = / . Thus, since / = we have either ^o\j/ = 
^ or ^ o y/ = . The latter is not the case, as ^ is not purely imaginary on the 
nonempty set Fix (xj/). □ 

The semigroup representation R : H(VF'*) End(M') will be given by a certain av- 
eraging process involving the standard representation of the Heisenberg group. The 
latter representation is defined as follows. For elements w = v + cv of the real vector 
space VFr, the operator 5{v) +/i(cv) is self-adjoint and its exponential 

7 , ._ i5(v)+i/l(cv) 
v+cv • — c 

converges and is unitary (see, e.g., |l9l). These operators satisfy the relation 

71^7;' = We^""^"'"'^ (w,w'gW^r), (3.2) 

where (O := iA|iyjj is the induced real symplectic structure. If T denotes the 

adjoint operation in End{£/v), it follows from 5(v)^ = /i(cv) that 

Tl = T_„ = T„' (wGWk). 
Thus if H .= X Ui is equipped with the Heisenberg group multiplication law, 

iw'.z') := (w + w',zz'e^«("'^')) , 

then {w,z) ^ zT^ is an irreducible unitary representation of H on .s^/y. It is well known 
that up to equivariant isomorphisms there is only one such representation. 
The oscillator representation x t-^ R{x) of ll{W^) is now defined by 

R{x) = I y,{w)T^dyo\{w) , y.M := <^)(x)e-?<-'"-^-) . 

Here dvol is the Euclidean volume element on Wv which we normalize so that 



f e-?<^'"'Mvol(w) = 1 . 



It should be stressed that we often parameterize VFr ~ V by the map v \^v + cv = w. 

Notice that by the positivity of 9^e(ax) the Gaussian function w i— > Yx{w) decreases 
rapidly, so that all integrals involved in the discussion above and below are easily seen 
to converge. In particular, since the unitary operator (for w G Wts) has L^-norm 
llrwll = 1, it follows for any x E H(VF^) that 

\\R{x)\\ < \(j){x)\ [ e-5<"''^^("-)'^^dvol(w) =: C{x) , 
where the bound C{x) by direct computation of the integral is a finite number: 

1/2 

, h = TMix). (3.3) 



Det(Idiv - h) 



Thus R{x) is a bounded linear operator on s/y- In Proposition 13. 171 we will establish 
the uniform bound ||7?(.x;)|| < C{x) < 1 for all x E M. It is also clear that the operator 
R{x) depends continuously on x G H(VF''). 
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The main point now is to prove the semigroup multiplication rule R{xy) = R{x)R{y). 
For this we apply the Heisenberg multiplication formula (|3.2I) to the inner integral of 

Rix)R{y) = I (I rAw-w')ry{w')Tw-w'Twdyo\{w')] dvol(w) 

JWr \JWis, ' / 

to see that R{xy) = R{x)R{y) is equivalent to the multiplication rule Yxy = Yx'^Jy where 
the right-hand side means the twisted convolution 

UryM-=[ 7x(w-w07^(w')e^''("""')dvol(wO. (3.4) 

For the proof of the formula Yx'^Yy = Yxy,^^ will need to know that ^ transforms as 

(l){xy) = (l){x)(l){y)Dct--2{ax + ay) . (3.5) 

This transformation behavior, in turn, follows directly from the expression for the semi- 
group multiplication rule transferred to the upper half-space i^J'; we record this expres- 
sion in the following statement and refer to [[8|, p. 78, for the calculation. 

Proposition 3.11. — Identifying ll(W^) with by the modified Cayley transforma- 
tion and denoting by {X^Y) ^XoY the semigroup multiplication on one has 

XoY + s={Y + s){X + Y)-\X + s) =X + s-{X-s){X + Y)-\X + s). (3.6) 

Given Proposition 13.1 11 to prove the transformation rule (13.51) just set X = ah and 
y = a/,/ and note that, since the semigroup multiplication law for H(W^'^) by definition 
yields a^ oa^f = a^hi , the first expression in (|3.6I) implies 

f{hh') = f{h)f{h')Det-'{ah + ah>) , (3.7) 

where f{h) = Det(a/, -|- s) as above. The transformation rule for ^ follows by taking 
the square root of (|3.7I) . As usual, the sign of the square root is determined by taking 
the positive sign at points of the lift of r+ in H(M^'^). 
Now we come to the main point. 

Proposition 3.12. — The twisted convolution for x,y G H(V7'^') satisfies Yx^Yy = Yxy- 
Proof. — Observe that the phase factor for w , w' G V7r can be reorganized as 

Inserting the definitions of Yx and Yy in Yx'^Yy we then have 

Yx\^Yyiw) = (^(x)(^(3;)e"?<"''"-'^^ J e-?<'^''(«-+«v)>v')+5(H'',(%+^)w)+i(w,(«,-.)w') dvol(w') . 

Since D\t{ax + ay) > 0, the integrand is a rapidly decreasing function of w' G and 
convergence of the integral over the domain VKr is guaranteed. 

We now wish to explicitly compute the integral by completing the square and shift- 
ing variables. For this it is a useful preparation to write 

(w', axw) = A(w', saxw) {w' G IVr) , 
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and similarly for the other terms. We then holomorphically extend the right-hand side 
to w' in VF, and by making a shift of integration variables 



w 



we bring the convolution integral into the form 

y^^y (w) =e-^^(^'^(^-^°«>'>''VW<^'(j) / e-5^(^''(^"-+-™-'>')dvol(w') , 

where o Uy = -5 + {ay + s) {a^c + ay) " ^ (a^ + s) =a^- {a^ - s) {a^ + ay) " ^ (a^ + s) is 
the semigroup multiplication on Using A{w,sw') = (w,w') for w G and the 
defining relation a^ oay = a^y, we see that the first factor on the right-hand side is 
Q-l{w,axyw) gy j-j^g transformation rule (13.51) the integral is evaluated as 



r clvol(wO = Dct" (a^ + a. 

JWo 



and multiplying factors it follows that 

which is the desired semigroup property. □ 
Corollary 3.5. — The mapping R : H(M^'') End(M') defined by 

R{x) = I 7xM7;,dvol(w) 

is a representation of the semigroup H(V7^). 

We conclude this section by deriving a formula for the adjoint. 

Proposition 3.13. — The adjoint ofR{x) is computed as R{x)'^ = R{\ir{x)). In partic- 
ular, R{x)R{x)^ =R{x\if{x)). 



Proof. — We recall the relations ^ = o i// from Proposition 13. 101 and {ah}^ = a 
from Remark [33l Since (w,a/,w) = (w, (a/j)^w) , it follows that 

Yx = Yyfix) ■ 

The desired formula, = R{\j/{x)), now results from this equation and the identi- 
ties = r_vi. and 7x(— w) = YxM- With this in hand, the second statement = 
R{x ^^^{x)) is a consequence of the semigroup property. □ 
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3.3.3. Basic conjugation formula. — Here we compute the effect of conjugating (in 
the semigroup sense) operators of the form q{w), w gW, with operators R{x) coming 
from the semigroup. This is an immediate consequence of an analogous result for the 
operators Tw . For this we first allow to be defined for w = v + (p eW hy 

These operators are no longer defined on Fock space, but are defined on 0'{V). They 
satisfy 

7;.rv, = r,+^,e-2^("'^). (3.8) 

Note that for x G H(W'^) and w eW the operators R{x)Tw and Tt;^(^^^„R{x) are bounded 
on £/y. Thus we interpret the following as a statement about operators on that space. 

Proposition 3.14. — For w eW andx G H(V7^) one has the relation 

R{x)T^ = T^^(^^^^R{x) . 

Proof. — For convenience of notation we write 

Rix) = (l){x) [ e-^^('^'^''^-*)r^dvol(> 



w . 



Thus 



R{x)T,, = ^{x) [ e-^^^^^'^-^-^^-^^^^'^^^rv^+H^dvoKw) . 



Now let h := Tni^) and change variables by the translation w ^-^ w ~w + hw . Using 
the definition sa^ = {Idw + h) {Idw —h)^^ and the relation 

A{{ldw -h)wi, {ldw + h)w2) = -A{{ld\Y +h)wi, {ldw-h)w2) 

for all wi,W2 G VK, one simplifies the exponent to obtain 

R{x)T^ = Hx) [ e-?^(*'-™-*)-5^(''^'^)r/,^+vpdvol(w) . 
JWr 

Reading (|3.8I) backwards one sees that this expression equals Th^Rlyx). □ 
The basic conjugation rule now follows immediately. 

Proposition 3.15. — For every x G H(V7'') and w eW it follows that 

R{x)q{w) = q{XH{x)w)R{x) . 

Proof. — Apply Proposition 13 . 1 41 for w replaced by tw and differentiate both sides of 
the resulting formula at ? = 0. □ 
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3.3.4. Spectral decomposition and operator bounds. — Numerous properties of R 
are derived from a precise description of the spectral decomposition of R{x) for x e M . 
Since every orbit of Sp^ acting by conjugation on M has nonempty intersection with 
r+ , it is important to understand this decomposition when jc e r+ . For this we begin 
with the case where V is one-dimensional. 

Proposition 3.16. — Suppose that V is one-dimensional and that the T^-action on 
W — V ®V* is given by x-{v-\-^) — Xv -\- (p where X> I. If f is a basis vector of 
V* then the monomials {/"*}meNu{0} ^ basis of s^y and one has 

R{x)f"' = X-"'-^/^f"' . 

Proof. — First note that if w = v + cv , then 

l+x . . 1+A 1+A-i A + 1, , 
a,w = • (v + cv) = - ^ V + = in + • (3.9) 

Thus the Gaussian function fxi^) in the present case is 

. ^ 1 ^+1 l..|2 

Yx{v + cv) = (j){x)e 2A-ilvi . 
To apply the operator Ty+cv to f"^ we use the description 

r^,+cv = e'^(^)+'^'('^) = eiM(cv)e-^|v|2gi5(v) _ 

Decomposing Ty+cv in this way is not allowed on the Fock space, but is allowed if 

we regard Ty^cv as an operator on the full space ^{V) of holomorphic functions. The 
calculations are now carried out on this larger space. 

Recall that 5{v)f'" = mf{v)f'"-\ From this we obtain the explicit expression 

m -l 

Ty+cvf"" = e-^l^l eiA^(-) £ -m(m - 1) • • • (m - / + l)/(v) V" 



—m\^m - Ly\^m-i-t i)J {V) ' 

1=0 

Our goal is to compute 



/ e-^i^HV,+,,/-dvol(v) , 
Jv 



where dvol(v) corresponds to dvol(w) by the isomorphism V ~ . Expanding the 
exponential e''^^'^^^ and using ju(cv)/'" = |vp/(v)~V"^^ the integral / is a sum of 
Gaussian expected values of terms of the form |vp^/(v)~^/(v)'. The only terms which 
survive are those with k — l. Thus 

-r|(-lK:)Xtf^e-^M^dvol,) 

Now ^{xf = D&t{ax + s)=Det{2s{ldw-TH{x)y^) = (-2/(1 - A))(2/(l - A^i)), 
and ^{x) = 2A^^/^(1 — since we are to take the positive square root at points 

xeT+. Hence, i?(x)/™ = 0(jc)2-i(l-A-i)>l -'"/'« = ^-'"-1/2/" as claimed. □ 
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Remark 3.5. — Note that asx&T^ goes to the unit element (or, equivalently, A — 1), 
the expression R{x)f"'' converges to /™ in the strong sense for all m G N U {0} . 

Now let V be of arbitrary dimension and assume that x G r+ is diagonalized onW = 
V(BV* in a basis {ei, . . . ,ed,cei, . . . ,ced} with eigenvalues Ai, . . . A^, Af ^ . . . , re- 
spectively. Since x G T^, we have A, > 1 for all i. For fi := cci and m := (mi, . . . ,mj) 
we employ the standard multi-index notation := /J"' ■ ■ ■/J'' and A"' := A|"' ■ ■ • Aj''. 
In this case the multi-dimensional integrals split up into products of one-dimensional 
integrals. Thus, the following is an immediate consequence of the above. 

Corollary 3.6. — Let x & be diagonal in a basis {e,} of V with eigenvalues A,- 
(/ = 1, . . . , Jj. Iff"' is a monomial /™ = Uiicei)'"', then R{x)f"' = A-'"-i/2ym 

One would expect the same result for the spectrum to hold for every conjugate 
gT-\-g^\ and this expectation is indeed borne out. However, in the approach we are 
going to take here, we first need the existence and basic properties of the oscillator 
representation of the metaplectic group. The following is a first step in this direction. 

Proposition 3.17. — The operator norm function Mp x r+ ^ M>^, [g, t) ^ \\R{gtg^^) \\ 
is bounded by a continuous Mp-independent function C{t) < 1 . 

Proof. — For any x G H(VK'^) we already have the bound ||i?(jc)|| < C{x) where C{x) 
was computed in (13.31 ). That function C{x) clearly is invariant under conjugation x i-^ 
gxg^^ by g G Mp . Evaluating it for the case of an element x = tET^ with eigenvalues 
Xi one obtains 

The inequality C{t) < 1 now follows from the fact that A, > 1 for all i . □ 

Since i?(x)'^ = R{y/{x)) and \\Ritg)f = \\R{tgyR{tg)\\ = \\R{g-h^g)\\, we infer the 
following estimates. 

Corollary 3.7. — For all t E and g G Mp one has \\R{tg) \\ < 1 and \\R{gt) || < 1 . 

3.4. Representation of the metaplectic group. — Recall that we have realized the 
metaplectic group Mp in the boundary of the oscillator semigroup H(W^*) and that 
H(V7'^) contains the lifted manifold r+ in such a way that the neutral element Id G Mp 
is in its boundary. Here we show that for x eT^ and g E Mp the limit lim_^^i(j7?(^x) is 
a well-defined unitary operator R'{g) on Fock space and R' : Mp U{£/y) is a unitary 
representation. The basic properties of this oscillator representation are then used to 
derive important facts about the semigroup representation R . 

Convergence will eventually be discussed in the so-called bounded strong* topol- 
ogy (see 1*85, p. 71). For the moment, however, we shall work with the slightly weaker 
notion of bounded strong topology where one only requires uniform boundedness and 
pointwise convergence of the operators themselves (with no mention made of their 
adjoints). Note that since ||i?(^.x;)|| < 1 by Corollary 13. 7 [ we need only prove the con- 
vergence of R{gx)f on a dense set of functions / G .s/y Let us begin with ^ = Id . 
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Lemma 3.4. — If a sequence Xn G r+ converges to Id G Mp, then the sequence R{xn) 
converges in the bounded strong topology to the identity operator on Fock space. 

Proof. — If / is any r+-eigenfunction, the sequence R{xn)f converges to / by the 
explicit description of the spectrum given in Corollary 13 .61 The statement then follows 
because the subspace generated by these functions is dense. □ 

Using this lemma along with the semigroup property, we now show that the limiting 
operators exist and are well-defined. 

Proposition 3.18. — If x,, E r+ converges to Id G Mp, then for every g G Mp the 
sequence of operators R{gx„) converges pointwise, i.e., R{gXn)f —>■ R'{g)f for all f in 
.i^y. The limiting operator R'{g) is independent of the sequence . 

Proof. — For any m,n G N there exists some t = t{m,n) G sufficiently near the 
identity so that Xm = t~^x,„ and x„ = t^^Xn are still in r+ . By the semigroup property 
R{gXn) = R{gt)R{xn) we then have 

\\R{gX„)f-R{gXn)f\\ < \\R{gt)\\ \\R{x^)f-R{xn)f\\. 

Letting t = t{m, n) Id it follows from Corollary 13. 7 1 that 

\\R{gX^)f-R{gXn)f\\ < \\R{x^)f-R{xn)f\\. 

Thus the Cauchy property of R{xn)f is passed on to R{gXn)f and therefore the sequence 
R{gXn)f converges in the Hilbert space s/y- Let linin-^^ R{gXn)f =: R'{g)f. 

To show that the limit is well-defined, pick from r+ another sequence y„ ^ Id , let 
\imn^ocR{gyn)f =: R"{g)f, and notice that \\R\g)f-R'\g)f\\ is no bigger than 

il^'(^)/-^(^-^n)/ll + \\R{gXn)f-Rigy„)f\\ + \\R{gyn)f-R"{g)f\\ . 
Using the same reasoning as above, the middle term is estimated as 

mgXn)f-Rigyn)f\\ < \\R{xn)f-R{yn)f\\ < \\R{xn)f-f\\ + \\Riyn)f-f\\ . 
In the limit n ^ oo this yields the desired result R'{g) = R"{g) . □ 

Remark 3.6. — Since < 1 the sequence R{gXn) converges to R'{g) in the 

bounded strong topology. Such convergence preserves the product of operators, which 
is to say that if A„ — > A and B„ B, then A„5„ — > AS . Indeed, 

\\{AnBn-AB)f\\ < \\A„{Bn-B)f\\ + \\{An-A)Bf\\ , 

and convergence follows from ||A„|| < 1 and A„ ^ A, 5„ B. Note in particular that 

if R{gXn)^R'{g) andR{g-'xn)^R'{g-') then R{gXn) Rig- 'xn) ^ R'{g)R'ig-'). 

The bounded strong* topology also requires pointwise convergence of the sequence of 
adjoint operators. Therefore we must also consider sequences of the form RigXnY . For 
this (see the proof of Theorem 13.11 below) we will use the following fact. 

Lemma 3.5. — Let {An} and {Bn} be sequences of bounded operators and let Cn := 
AnBfi. IfCn and Bn converge pointwise with Bn ^ B and the sequence is uni- 
formly bounded, then An converges pointwise on the image ofB. 
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Proof. — If / G im5 then / = lim/„ where /„ = Bnh for some Hilbert vector h. Write 

iA-m ^n)f — ^mi^f + {^mBm ^n^n^h /) 

and use the uniform boundedness of A„ to show that Anf converges. □ 

Applying this with A„ = R{gXng^^),Bn = R{xn) and C„ = A„5^ = R{gx„)R{g~^Xn), we 
have the following statement about convergence along the conjugate gT-^g^^. 

Proposition 3.19. — For g G Mp and {x„} any sequence in r+ with ;c„ ^ Id G Mp, it 
follows that R{gXng^^) converges pointwise to R'{g)R'{g~^). 

Next, if we take three sequences in r+ and write 

R{XnynZn) = R{Xng-^)R{gyng'^)R{gZn) ^ Id^y , (3.10) 

then it follows that the sequence R{xng^^) converges to an operator B{g^^) on the 
image of R'{g)R'{g-^)R'{g) with B{g-^)R'{g)R'{g-^)R'{g) = Id^^ . In particular, the 
operator R'{g) is injective for all g G Mp . Finally, we define j„ by yf^ = Xn and write 
R{gXn) = R{gyng^^)Rigyn) ■ Taking the limit of both sides of this equation entails that 

R'ig)=R'{g)R'ig-')R'ig), (3.11) 

and since R'{g) is injective, this now allows us to reach the main goal of this section. 

Theorem 3.1. — For every g G Mp and every sequence {jc„} C Tj^ with Xn Id the 
sequence {R{gXn)} converges in the bounded strong* topology. The limit R'{g) is in- 
dependent of the sequence and defines a unitary representation R' : Mp \][£^y). 

Proof — From dMB we have i?'(^)(Id^j, -i?'(^"i)i?'(g)) =0 and, since i?'(^) is in- 
jective, R'{g^^)R'{g) = Idj^y . Hence R'{g^^) is surjective, and thus R'{g) G GL(M') 
by exchanging g g^^. For the homomorphism property we write R{g\Xn)R{g2yn) = 
R{g\Xng2yn) =R{g\Xng'^^)R{g\g2yn) and take limits to obtain i?'(^i)i?' (^2) =R'{g\g2). 

Convergence in the bounded strong* topology also requires convergence of the ad- 
joint. This property follows from R^gXriY = R{\}f{gXn)) = R{xng^^) and the discussion 
after (13.101) . since R'{g) is now known to be an isomorphism. Unitarity of the represen- 
tation is then immediate from R{gXny R'ig)^ and R{xng~^) B{g~^) = R'{g)^^. 

Finally, we must show that R' : Mp U(M') is continuous. This amounts to show- 
ing that if {gk} is a sequence in Mp which converges to g, then R'{gk)f — »• R'ig)f 
for any / G £/v- Hence, we let {xn} be a sequence in with Xn Id and choose 
t — t{m, n) as in the proof of Proposition 13 . 1 81 so that 

\\R{gkX,„) -R{gkXn)\\ < \\R{gkt)\\ WRiXm) -R{Xn)\\ , 

and then let ? — > Id. Using the uniform boundedness of R{gkt) as ? — *• Id, this shows 
that the convergence R{gkXn) R'{gk) is uniform in gif_ . Since we have gkXn — > gXn for 
every fixed n , the continuity oix^ R{x)f then implies that R'{gk)f R'{g)f- n 

Let us underline two important consequences. 



48 



A. HUCKLEBERRY, A. PUTTMANN AND M.R. ZIRNBAUER 



Proposition 3.20. — For g\,g2 G Mp and x G H(l¥'*) it follows that 

R{gixg2)=R\gi)R{x)R\g2). 

Proof. — If jm and Zn are sequences in which converge to Id , then, since x^R{x)f 
is continuous for all / in Fock space, R{giymXg2Zn) converges pointwise to R(gixg2). 
On the other hand, we have R{g\_ym^g2Zn) = R{g\ym)R{^)R{g2Zn) by the semigroup 
property, and the right-hand side converges pointwise to R'{gi)R{x)R'{g2). □ 

We refer to R' : Mp U(M') as the oscillator representation of the metaplectic group. 
It has the following fundamental conjugation property. 

Proposition 3.21. — Let Mp xW -^W, (g^w) ^— T{g)w denote the representation of 
Mp on W defined by first applying the covering map Mp Sp]^ and then the standard 
representation ofSp. If we let W act on a{V) by the Weyl representation q then 

R'{g)q{w)R'{g)-'=q{z{g)w). 

Proof. — Since the inverse operator R'{g)^^ is now available, this follows from the 
conjugation property at the semigroup level (see Proposition 13. 151) . □ 

Note that analogously we have the classical conjugation formula for the representation 
of the Heisenberg group on the Fock space .sz/y, i.e., 

R\g)Z,R\g)-' = T,^g)^ 

for all g G Mp and w E Wr (see Proposition 13. 141) . 

3.4.1. The trace-class property. — The concrete formula for the eigenvalues of R{x) 
which is given in Propo sition 13 . 6 1 show s that if xETj^, thenR{x) is of trace class. Using 
the conjugation property proved above, we now show that this holds for all x E H( W^) . 

Proposition 3.22. — For every x E }i{W^) the operator R{x) is of trace class. 

Proof. — We must show that the operator R{x)R{xy has finite trace. To verify this 
property observe that R{x)R{x)'^ = R{y) with y := x\lir{x) E M . Since y = gt^g^^ for 
some t eT+ and R{gt^g^^) = R'{g)R{t)R'{g)^^, the desired result follows from the 
explicit formula in Proposition l3.6l for the eigenvalues oft . □ 

Proposition 3.23. — For every x E H(V7'^) one has 

TrR{x) = 2-'^'^c^(j){x) . 

Proof. — Since the representation of the Heisenberg group H on s/y is irreducible, 
the space of bounded linear operators End{,s/v)^ that commute with the //-action is 
just Cldj^y . Now the dual of the space of trace-class operators is the space of bounded 
linear operators itself, where a bounded linear operator A is realized as a functional 
on the trace-class operators by Fa{B) := Tr(A5) (see [9]). Invariance of F^ by the H- 
representation is equivalent to the invariance of A as an operator. Thus, an //-invariant 
bounded linear functional on the space of trace-class operators is just a multiple of Tr . 
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We construct such a functional, 4> , by letting 1 be the vacuum in s^y and averaging 
the expectation in Tv^, 1 G s^y over all w G Wr : 

^{L):= f {T^l,LZA)^dvo\{w). (3.12) 

Indeed, the representation of H is unitary and by using = T^^^ along with the basic 

property T^T^^i = T^^,_^_^^le^'^^^''^'\ one shows that 4> is invariant, i.e., <^{TwLT~^) = 
4>(L) for all w G VFr. If L := l{l,-)s^y is the projector on the vacuum, then it is a 
simple matter to show that 

Tr^,(L) = y2'^''""'«4>(L). (3.13) 

Thus, this formula holds for any bounded linear operator L of trace class. 
Now 4>(i?(jc)) is computed as 

^{R{x))= f (t^\J Uw')T^dvo\{w')T^\\ dvol(w). 

Due to the fact that 7x(w') is rapidly decreasing, we may take the expectation inside 
the inner integral: 

^{R{x))= [ [ r,(wO(r^i,r^'r,i)^^dvoi(w')dvoi(w). 

Again using the basic properties of T^^ , we see that 

(r,,i,r^,r,,i) = e^"(^''^)(i,r,,,i) = e'«('^''^)-?<^''^'^ . 

Thus the inner integral over w' is a Gaussian integral, and evaluating it we obtain 

/ 7x(w )e-^<^''>^'')+i«K,"')dvol(w') = (^)(;c)Det-5(a, + Idvi/)e-<^^'("^+^'^'^)"'^'^^ . 

Integrating this quantity with respect to dvol(w) we obtain 

4>(i?(x)) = 2-'^™^«(^(x) , 
and the desired result for the trace follows from (13.131) and dimWR = 2dimc V. □ 

Proposition 3.24. — For every Pi,P2 in the Weyl algebra and every x G H(V7^') the 
operator q{P])R{x)q{P2) is of trace class on the Fock space s^y. Furthermore, the 
function H(V7''') ^ C, x i— > Tr:q{P\)R{x)q{P2), is holomorphic. 

Proof. — (Sketch) It is enough to show that q{P)R{x) is of trace class for the case that 
P is a monomial operator, i.e., q{P) = iJ.{cv)^5{v'Y . We must then compute the trace 
of the square root of C{y) = q{P)R(y)q{Py for y = x\fr{x) G M . For this, recall that 
the t-operation interchanges multiplication and differentiation. Direct computation of 
I ^/C{y)f'"\ shows that this number is of the order of magnitude of A^™m^+^ where A 
is the torus element corresponding to ^^y. Thus the conjugated operator has effectively 



the same trace as R{y/y) itself and in particular Tr^yc{y) < o° . 
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Turning to holomorphicity, if we insert the equation L{x) = q{P])R{x)q{P2) in the 
formula (13.121) for the trace and use the definitions to compute the various integrals, 
then the function F{x) = 4>(L(a:)) is of the form 



where g{x,-) is a rapidly decreasing function on and g{-^w) is holomorphic on 
the semigroup H(M^''). Since the 5;i-operator can be exchanged with the integral, it is 
immediate that F is holomorphic and therefore so is Tx q{Pi)R{x)q{P2) ■ □ 

3.5. Compatibility with Lie algebra representation. — We now show that the semi- 
group representation R : H(W^^) End(,e/v/) is compatible with the sp-representation 

Let h E }i{W^) and Y E sp. Then, since the semigroup H(W^) is open in Sp, there 
exists some e > so that the curve [— e,e] 3 t ^-^ e'^h lies in H(V7''). Fix some point 
X e "Cf^^{h) and let t ^-^ e.'^ -x denote the lifted curve in H(W^'*') . 



Lemma 3.6. — For all x E H(VF'*) and all 7 G sp it follows that 

d_ 
dt 



R{&" ■x)=q{T-'{Y))R{x) . 

1=0 



Proof. — Recall that the operator is the result of integrating the Heisenberg trans- 
lations against the Gaussian density Yx{w) dvol(w). Thus 



d_ 
dt 



R{e''-x)= [ 

T JWl 



d 
dt 



Ye'Y-xMTwdvoliw) . (3.14) 

t=0 



t=0 

For wi,W2 e W the linear transformation Y : w ^-^ wiA(w2,w) +W2A{wi,w) is in 
sp, and sp is spanned by such transformations. It is therefore sufficient to prove the 
statement of the lemma for Y of this form. Hence let Y := wiA(w2, ■) + W2A{wi, ■) and 
observe that the corresponding element in the Weyl algebra is 

Now, defining for w eW by = e'^^"') as before, we have 



qit-\Y))R{x) 



d 



2 



dtidt2 

Therefore, for w := tiwi -\-t2W2 consider the expression 

T^R{x) = f y^{w)T^T^dwo\{w) 



Ttiw\+t2W2^{^) ■ (3.15) 

ri=f2=0 



Using T^Tyv = e ^^^^'"^^T^^^v and shifting integration variables w — w — vv we obtain 
T^R(x)= [ Yx{w-w)e'^^^'^^'''^T^d\ol{w) . (3.16) 
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Comparing Eqs. (13.1513.161 ) with (13.141) we see that the formula of the lemma is true if 



d 
dt 



f=0 



dtidt2 



Yx[w-tiW\-t2W2)Q ^ 



\A{tiWi+t2W2^v) 



ti=t2=0 

But checking this equation is just a simple matter of computing derivatives. Recall that 

y^(w) = 0(x)e" and ^(x) = Det^/^(ax + Writing h := Th{x) and using 
Try = one computes the left-hand side to be 

r^'y.M = 7x(w) {\Tr{Ysa,) + ^A{h{l -h)-'w,Yh{l -h)-'w)) . 



dt 



f=0 



On substituting Y = wiA(w2, ■) + W2A{wi,-), this expression immediately agrees with 
the result of taking the two derivatives on the right-hand side. □ 



4. The extended character 

Having prepared the algebraic foundations and the necessary representation- 
theoretic tools (^3]), we now turn to the main part of our work, which is to prove the 
formula (11.11) for the ^-Haar expectation value I{t) of a product of ratios of character- 
istic polynomials. We will achieve this goal by exploiting the fact that I{t) is the same 
as the character x{t) of the irreducible ^-representation on .s2/y. The key property de- 
termining ;t is a system of differential equations coming from the Casimir invariants 
of the Lie superalgebra g : acting as differential operators on a certain supermanifold 
^ of Lie supergroup type, these invariants annihilate ;f as a section of 

4.1. GeneraUties on Lie supergroup representations. — 

4.1.1. Grassmann envelopes. — For a Z2-graded complex vector space V = Vq®V\ 
letEnd(y) =0[(V) be the Lie superalgebra with bracket [X,X'] =XX' -{-\)\^\\^'\X'X. 
Then, given any finite-dimensional complex vector space C^, define the Grassmann 
envelope of End(y) by the Grassmann algebra Q = A(C'^') = f^o © as 

Endn(y) = ®s {^s ® End(y),) , = ®k>Q A^^^' (C^) • 
The Grassmann envelope EndQ,{V) is given the structure of an associative algebra by 

{(O^X){(o'®X') := (-l)l"ll'''l(OCo'®XX', 
and it also has the structure of a Lie algebra by the usual commutator: 

[{(O0X),{(o'^X')] = o)'o)®[X,X'] . 

More generally, if = go ©01 C End(y) is a complex Lie (sub)superalgebra, the 
Grassmann envelope g{^) of g by f2 is still defined in the same way: 

:=©,(^2,(8)g,) , 

and it still carries the same structure of associative algebra and Lie algebra. The su- 
pertrace STr : g(f2) Q.o is defined by (O0X coSTrX. Note that this satisfies 
STr[^,r]]=0forall^,T]Gg(t2). 
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The Grassmann envelope g(n) is Z2-graded by g{^) = 0o © 0i where = Q.s ® Qs . 
There also exists a Z-grading, which is induced by that of Q; this is g{Q.) = ©/tfl'^^'' 
with 0(2/+^) = a2'+-^(C^) (g)0,. Note that [g^^^J^')] C 0(^+'). Hence, n := ©^>i0(^) 
is a nilpotent ideal. The subspace go is a Lie subalgebra and we have go = g^^^ C go • 
The following is an elementary statement found, e.g., in 111. 

Lemma 4.1. — Let x G Endfi(V) and consider the decompositions x = xq + xi and 
X = x^^^ + . . . +x^^^ with respect to the Z2- and Z-gradings o/Endfi(V). The element x 
is invertible in Endfi(y) if and only ifxo is invertible, and the latter is the case if and 
only ifx^^^ e GL(Vb) x GL(\/i). 

Let G{Q) be any Lie group such that Lie(G(^2)) = 0(^2). Following ^ we write 

G = exp(go) C G{Q.) , G(a)o = exp(go) C G{Q.) , 

G(f2)i =exp(gi) , N{Q.) = exp{n) , A^(a)o = exp(nn0o) . 

The objects G, G{a)o,N{Q.), and A^(f2)o are subgroups of G{Q.). The group N{a) is 
a normal subgroup of G(Q). Here is another elementary result from HI: 

Lemma 4.2. — Each element g G G(n) has a unique factorization of the form g = 
gO\ = 62g with g G G{Q.)q and 0i,02 ^ G{^)i- Each element g G G{D.)o can be 
uniquely represented in the form g = gon^ = nigQ with go E G and ni , ^2 ^ ^(^)o- 

4.L2. Lie supergroups. — A complex Lie supergroup is a pair (g , G) consisting of a 
complex Lie superalgebra g = 0o ©0i and a complex Lie group G that exponentiates 
go , i.e., Lie(G) = go . Given a Lie superalgebra g there exist, in general, several choices 
of G. If g ^ End(y) is a faithful finite-dimensional representation of g, i.e., g C 
End(y), then one choice is G := exp(go) C GL(yo) x GL(yi) C End(y)o . 

A superfunction on a complex Lie supergroup (g , G) is a section in the sheaf ^ = 
^{G, gi) of germs of holomorphic functions on G with values in A(gj). This sheaf ^ 
is a locally free sheaf of ^^-modules where is the sheaf of germs of holomorphic 
functions on G. The gradings on /\{g\) give a Z-grading ,^ = ©yt^*^^-* and a Z2- 
grading ^ = ®^\. If / = Z*-*^-* + . . ■+ f^^^^ is the decomposition of a superfunction 
/ with respect to the former, then num(/) := f^'^^ is called the numerical part of /. 

A superderivation D G Der is a linear sheaf morphism D : ^ ^ ^ satisfying the 
graded Leibniz rule D{fh) = {Df)h + (-l)l^ll-^l/(D/z) for f,he^. The Z2-grading 
of ^ defines a Z2-grading on the vector space Der^ by |D| = 5 if C ^s+t ■ 

4.L3. Representation ofg by superderivations . — In the theory of ordinary Lie groups 
one has a realization of the Lie algebra by left- or right-invariant vector fields acting 
as derivations of the algebra of differentiable functions on the Lie group. In the same 
spirit, one wants to construct a representation of the Lie superalgebra g by superderiva- 
tions on the sheaf of algebras ^ . The basic tool for this construction is a correspon- 
dence between superfunctions / G ^ and functions on G(f2) with values in Q. . There 
exists no canonical correspondence of such kind; one possible choice is as follows. 
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Let {^i, . . . be a basis of go, and let {Fi, . . . be a basis of Qi with dual 
basis (^1, . . . , (^jj of gj. Then if X G flo andZ'^ denotes the corresponding left-invariant 
vector field on functions (p on G, 

we assign to a section f = Y^j fj /\- ■ ■ /\ ^j,. E ^ a function : G{Q.) ^ Q.hy 

^^^g,La^m,LPm) = ^/e^«.-^f /,) (g) /3,, A ■ ■ ■ A /3,, , 

where a,- G and /3j G . The assignment / i-^ is injective if ^2 = A(C'^) and 
d>di; and is so in particular if = q\. In that case, the inverse mapping h-^ / is 
given by restriction to elements g = g^^j®^j with g E G. 

The advantage of passing to the right-hand side of the correspondence / ^ 4>y is 
that functions on G(^2) can be shifted by elements of G(n) by multiplication from 
the left or right. This possibility now puts us in a position to construct the desired 
representation of the Lie superalgebra g by superderivations on the sheaf ^(G, gi). 

Consider first the case X G go- Making the choice Q. := A{q\) and linearizing the 
function M x G{Q.) ^ Q., {t,g) t-^ ^'{e^'^g) with respect to the parameter of the one- 
parameter group t i-^ e'^, we obtain a first-order differential operator X^: 

Similarly, X'^ is defined by ^{ge'^) = ^(|) + {tX'^^'){g) + ff{t^). Derivations X' on 
^ are then given by X' := 4>^^ oX' o4>, i.e., by the equation 4>^,y = X'^f (z =L,R). 

To handle the case X G gi , we need one extra anti-commuting parameter for the pur- 
pose of differentiation. Denoting this parameter by T we choose Q := A(g| © Ct) and 
define 1^"^ by ^(e^^®^!) = ^(|) + (t1^^) (|) and ^(|e^®^) = ^(|) + {TX^'¥){g) . 
Again, the corresponding derivations on ^ are X^'^ := 4>^^ oX^'^ o 4>. 

On basic grounds [1] one then has the following statement. 

Lemma 4.3. — The assignments X ^-^ X^ andX y-^ X^ are representations of the Lie 
superalgebra g on the sheaf ^{G, gi) of superfunctions. The two representations com- 
mute in the graded-commutative sense, i.e., X^Y^ — ( — 1)1^1 1^1 y^X^. 

4.L4. Representations and characters of Lie supergroups. — K representation of a 
Lie supergroup (g, G) on a Z2-graded vector space V = Vq®Vi is a homomorphism 
of Lie superalgebras : g ^ End(V) and a homomorphism of Lie groups p : G 
GL{Vo) X GL(yi) C GL(y) which are compatible in the sense that {dp)e = p^lgo ■ 

Example 4.1. — Given a Z2-graded vector space U = Uo(BUi, consider the Lie su- 
peralgebra gl{U) and the Lie supergroup (g[(i7),GL(t/o) x GL{Ui)). For any integer 
m the two maps p : GL(f/o) x GL([/i) C^, (^o,^i) ^ Det"'(^o)Det-'"(^i), and 
p* : g[([/) ^C,X^ mSTrX, define a representation of (g[(t/),GL(t/o) x GL(t/i)) 
on the Z2-graded one-dimensional vector space Vq © Vi with Vq = C and Vi = {0} . 
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The character % associated with the representation (p*,p;y) of a Lie supergroup 
(g, G) is the superfunction 

Z:G^A(0l), ^^STrKp(^)e^^>P*(^^), 

provided that the supertrace exists. Note that the numerical part mxm{x) of the charac- 
ter is just the supertrace of the Lie group representation p : G ^ GL(Vo) x GL(Vi). 

An element / G ^(G, 0i) is called radial if the associated function : G{Q.) Q. 
satisfies ^f{g-^hg) = ^f{h) for all g,he G{Q.) and if {X^ = for all XeQi. 

Lemma 4.4. — The character of a Lie supergroup representation is radial. 

Proof. — Let x be the character associated with the representation (p*,p;y) of a Lie 
supergroup (g, G). Then by the definition of the correspondence % ^ one has 

*J>z(^oe^«'-®^'e^^^®^0 = STryp(go)e^«'P*(^')e^^^-P^ , 

where the notation above {gQ E G, a, G Q.o, /3j G f^i) is being employed. This satisfies 
= ^^{g-^hg), since STr(Xy) = STr(yX) for XJe End£^(y) and the repre- 
sentations p* and p are compatible. For X G gi the infinitesimal (or linearized) version 
of the same argument gives {X^ + X'^)^^ = and hence {X^ +X^)X = • D 

4.2. Character of the spinor-oscillator representation. — In Chapter [3] we con- 
structed a semigroup representation Rq : H(Wq) End{£/v) and a group representa- 
tion R' : Mp U{£/v) which exponentiate the restriction of the spinor-oscillator rep- 
resentation p* to sp C ospo • These are compatible in the sense that H(Wq ) = Mp x M, 
Mp acts on M by conjugation, and ^o(,?i'^.?2) = R'{8i)Roix)R'{82) for all ^1,^2 ^ Mp 
and X G H(VKq). The representation p*|o : C ospo dK-^v) exponentiates to a Lie 
group representation Ri : Spin(Wi ) GL(£/v/) • Note that i?i and Rq commute, as they 
act on the two different factors of the tensor product a{V) = A{Vl) 0S{Vq). 

Note also that the group Z2 acts on H(Wq) and Spin(VKi) by deck transformations of 
the 2 : 1 coverings ^{W^) H(W(J) and Spin(W^i) SO(W^i). The non-trivial element 
of Z2 is represented by a sign change, Rq —Rq and Ri —Ri- 

4.2. L Spinor-oscillator character as a radial superfunction. — Given the represen- 
tations R\ and Rq , we form the semigroup representation 

R : Spin(W^i) xz^ H(l¥(^) ^ End(^v) , {gi^go) ^ Ri^gMgo) . 

We already know the representation 7? to be compatible with p* : osp ^{{s^y). Now 
we define a superfunction yon Spin(Wi) x^j H(W'q) with values in A(ospj) by 

r(^i,^o) =STr^^i?(gi,go)e^^^P*(^^) , 

where {Fi, . . . is a basis of ospj and {(^1, . . . , i^^j} is its dual basis. We refer to 7 as 
the spinor-oscillator character. By the circumstance that R and p* are representations 
on the infinite-dimensional vector space S2^y we are obliged to discuss the domain of 
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definition of 7. For this, notice that Spin(iyi) acts non-trivially only on the finite- 
dimensional (or spinor) part of s^y . Expanding e^^^ ''*'^^^) we obtain a finite sum 

with Pj E c{{W). (Here we recall that ospi can be viewed as part of the Clifford-Weyl 
algebra c\{W) by the isomorphism T^^ : osp — s C q(VF).) By Proposition 13.241 the 
operator 7? (^)p*(i'7) is of trace class. Thus the character 7 is defined on the full domain 
Spin(Wi) x^j H(Wq ). Moreover, 7(g) depends analytically on g. 

Does there exist any good sense in which to think of the spinor-oscillator charac- 
ter 7 as a radial superfunction? There is no question that for every X E osp we do 
have superderivations and X^ on ^(Spin x H), and the function 7 by its defini- 
tion as a character does satisfy {X^+X^)x = 0. However, our semigroup elements 
g E Spin(Wi) xz^IKWq) do not possess an inverse in the spinor-oscillator representa- 
tion and we therefore shouldn't expect such a relation as (i>^{g^^hg) = (^j^{h). 

A substitute is this. Let SpiU]^ C Spin(VKi) be the compact real subgroup which is 
obtained by exponentiating the skew- symmetric degree-two elements of the Clifford 
algebra generated by a Euclidean vector space Wi r C Wi . Let Gr := SpiuR x^^ Mp . 
Then on the real submanifold Spiuj^ x Mgp (with Msp formerly denoted by M) the 
superfunction 7 is GR-radial, since the representations R' of Mp and Rq on M^p C 
H(WJ) are compatible. As a result, we will later be able to apply Berezin's theory of 
radial parts of Laplace-Casimir operators. 

4.2.2. Numerical part of the character. — Here we show that the restriction of the 
numerical part of 7 to a toral set Ti x^^ r+ in Spin(Wi) x^j H(Wq) gives the auto- 
correlation function described in ^ That is, we show that the ratios of characteristic 
polynomials Det(IdAr — e^*^^) and their averages with respect to a compact group K 
(with k E K C Un and ^ being a parameter), can be expressed as supertraces of opera- 
tors on the spinor-oscillator module a{V) and the submodule of ^-invariants a{V)^. 

We begin with a summary of the relevant facts. From Proposition 13. 151 we recall the 
basic conjugation rule for the oscillator representation: 

Ro{x)q{w) = q{xH{x)w)RQ{x) , 

where x E H(Wq) , w G Wq, and T//(jc) E H(Wq) C Sp(Wb). On the side of the spinor 
representation, the corresponding conjugation formula is 

R\{y)q{w) = q{Xs{y)w)Ri{y) , wEWi.yE S^m{Wi) . 

This defines the 2:1 covering homomorphism Spin(VV'i) SO(Wi), y ^ T5(y), which 
exponentiates the isomorphism of Lie algebras T : s fl C2(VKi) o(Wi). 
Recall also (from Proposition 13. 231) the formula for the oscillator character: 



Tr i?o {x) = ^{x), ^{x)^ = Det- ^ (Idiv„ - Th [x) ) 
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An analogous result is known for the case of the spinor representation; see, e.g., the 
textbook [2]. Defining the spinor character as the supertrace with respect to the canon- 
ical Z2-grading of the spinor module, one has 

STri?i [y) = xj/{y) , Xj/iy)^ = Dct{ldw, - Tsiy)) ■ 

Thus the spinor character, just like the oscillator character, is a square root. By taking 
the supertrace over the total Fock representation space, we obtain the formula 



ST,..,.,(>')^o(.) ^ MS^iy) ^: ^l ^:^|y (4.1) 

For Wo = Wi , the case of our interest, Spin(Wo) intersects with H(Wo ) and the square 
root y/{y) is defined in such a way that \ir{x) =^{x)-^forxe Spin(Wb) nH(Wo'). 

Let now U = Uq^BUi be a Z2-graded vector space, and letV = U ® . The Lie 
group GL(yi) X GL(yo) acts onW = {V^ © ) © (Vq © V*) by 

(^i,.?o)-(vi©(pi©vo©(Po) = Uivi)©((Piog7i)©(govo)©((Poo^o^) • 
This action serves to realize the group G := (GL(i7i) x GL([/o)) GL(C^) as a sub- 
group of GL(yi) X GL(Vo) C SO(Wi) x Sp(Wo). For the purpose of letting G act in the 
spinor-oscillator module a{V), let this representation be lifted to that of a double cover- 
ing G "-^ Spin(Wi) x^2 H(Wq ). The following statement gives the value of the spinor- 
oscillator character on (tiJo;g) G G where ^ G GL(C^) andts = diag{ts^i,...js,n) are 
diagonal matrices in GL(t/^) (for 5 = 0, 1). 

Lemma 4.5. — IfdimllQ = dimi7i = n and |?o,;| > 1 for all j = 1, . . . ,n, then 

STr R(r r-.)-Jl 1^" ^^^n - {tLj8)-') 
1=1 V ^'^' Det(IdA,-(?o,jg) ^) 

Proof. — Since ti and tQ are assumed to be of diagonal form, the statement holds true 
for the case of general n if it does so for the special case n=\. Hence let n = 1 . 

In that case ti and tQ are single numbers and tsg acts on = © V* ~ © (C^)* 
as (tsg) . ( V © (p) = (tsgv) ®(po (tsg) ^ ^ for 5 = 0, 1 . From equation (|4.1I) we then have 



.T., r.^, , . ^ Det(Id^-?ig)Det(Id^-(rig)-i) 
STr^^y)Rituto,g) = yDet(Id^_,,^)Det(Id^_(,„^)-i)' 

which turns into the stated formula on pulling out a factor of Det(— ?i^)/Det(— ?o^) 
from under the square root. (Of course, the double covering of GL(t/i) x GL(i7o) is to 
be used in order to define this square root globally.) □ 

In the formula of Lemma |43] we now set tij = e.'^^j and toj = Q^i . We then put g^^ = 
k E K and integrate against Haar measure dk of unit mass on K. This integral and the 
summation that defines the supertrace can be interchanged, as STrj,(^/-)i?(?i,fo;^^^) is a 
finite sum of power series and the conditions £He > ensure uniform and absolute 
convergence. The representation of K on a{V) is induced by the representation of K 
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on V. Therefore, averaging over K with respect to Haar measure has the effect of 
projecting from a{V) to the ^-trivial isotypic component a{V)^, and we arrive at 

ST,,,.,,,,,o;.d)^e<-.«^.-«/n^i^^... (4.2, 

In the case of an even dimension A'^, the domain of definition of this formula is a 
complex torus T := Ti x where Ti = (C^)" and C (C^)" is the open subset 
determined by the conditions \toj\ = e^^'^J > 1 for all j . For odd A^^ we must continue 
to work with a double cover (also denoted by T) to take the square root l^)^A^Vn^j) 

Let be the Howe dual partner of Lie(A') in osp{W). We know from Proposition l2.1l 
that g = 05p{U © U*) for if = O/^ and g = osp(C/ © U*) for K = USpyy • Recall also 
from ^2.6.11 that the g-representation on a(y)^ is irreducible and of highest weight 
Xn = (N/l) Y.j{Wj ~ 0;)- Denote by the set of weights of this representation. Let 
5y = ( — 1) 1^1 dim a(y)^y be the dimension of the weight space a{V)^y multiplied with 
the correct sign to form the supertrace. 

Corollary 4.1. — On the torus T we have 

rCT» I '=1 Del(Id„-e-*- t) 

Remark 4.1. — On the right-hand side we recognize the correlation function (see ® 
which is the object of our study and, as we have explained, is related to the character 
of the irreducible g-representation on <x{V)^ . The left-hand side gives this character 
(restricted to the toral set T) in the form of a weight expansion, some information about 
which has already been provided by Corollary |2.3| of S2.6.1[ 

4.3. Formula for the character. — Being an eigenfunction of (the radial parts of) 
the Laplace-Casimir operators that represent the center of the universal enveloping 
algebra U(g), our character % = Y^yByC^ satisfies a certain system of differential equa- 
tions. Here we first describe the origin and explicit form of these differential equations. 
We then prove that x is determined uniquely by these in combination with the weight 
constraints for y eTx. Finally, we provide the explicit function with these properties. 

4.3.1. Extended character. — Formula (14.21) and Corollary 14. ll express the character 
X a function on the toral set T. Our next step is to describe a supermanifold with 
a g-action where x exists as a GR-radial superfunction and Laplace-Casimir operators 
can be applied. Here we give only a rough sketch, leaving the details to the reader. 

First of all, the symmetry group Gr for x has to be identified. Recall from the end 
of ^4.2.1| that the good real group acting in the spinor-oscillator representation £/y is 

Spin(Wi,R)xz2Mp(W^o,K) =:G' , 

which contains K = Opj and K = USp^ as subgroups. Since we are studying the char- 
acter X of the g-representation on the subspace £/y of ^-invariants, we now seek the 
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subgroup Gr C G' which centralizes K; this means that we are asking the exponenti- 
ated version of a question which was answered at the Lie algebra level in ^2.71 Here, 
restricting the group G' to the centralizer of K we find 



We observe that Gr for the case of ^ = On is just the lower-dimensional copy of G' 
which corresponds to Us taking the role of Vj • We also see immediately that the Lie 
algebras Lie(GR) coincide with the real forms described in Propositions |2.4| and 12.51 

The second object to construct is a real domain Mr C Spin(Wi) x^^ H(Wq) with a 
GR-action by conjugation such that Mr = Gr.Tr where Tr C T is a real sub-torus. 
The choice we make for Tr is the one singled out by the parametrization ?i,y = e"''^ 
and ?o,/ = e*^^ with real- valued coordinates \\fj and (^j. We also want the elements of 
Mr to commute with those of K as endomorphisms of W . By these requirements, the 
good real domain Mr to consider in the case of ^ = On is the lower-dimensional copy 
of SpinR X Msp which, again, corresponds to Us replacing V^. . By the detailed analysis 
of ^ (where Msp was simply denoted by M) and the fact that the diagonal elements 
constitute a maximal torus in SpinR , we infer the desired property Mr = Gr.Tr . 

In the case of ^ = USp^y the same requirements lead to the choice 



where the construction of Mso is fully parallel to that of Msp: if SO denotes the 
complex orthogonal group of the vector space Uq®Uq, we introduce the semigroup 
H C SO which is defined by the inequality g^sg < giox s = — Id^/,, ©Id(/* and then take 
Mso C H to be the totally real submanifold Mso C H of pseudo-Hermitian elements 
m = sm^s . For this choice we easily check that Mr = Gr.Tr . 

Having constructed a manifold Mr with an action of Gr by conjugation, we now 
consider the supermanifold ^(MR,gi) which is the sheaf of algebras of analytic 
functions on Mr with values in A{g\) where, once again, we remind the reader that 
= osp{U © U*) for iS: = Oa^ and = osp{U © U*) for K = USp^ . By construction, 
for every point x G Mr we have Tj^Mr ® C ~ go » the even part of the Lie superalgebra 
g . Hence by the basic principles reviewed at the beginning of this Chapter, the super- 
manifold ^(Mr , gi) carries two representations of q by superderivations {X t-^ and 
X X^). The benefit from all this is that for every Casimir invariant I E U(g) we now 
get a Laplace-Casimir operator D{I) on ^ by replacing each X E gin the polynomial 
expression for / by the corresponding differential operator X^ (or X^) . 

Utilizing the present setting the character x, which was given in (|4.2I) as a function 
on T, will now be extended to a section of ^(MR,gi). By construction, the direct 
product Mr X ^ is contained as a subspace in Spin(V7i) x^^ H(Wq), and by restriction 
of the representation R we get a mapping R : Mr x ^ End{£/v) whose image still 
lies in the subspace of trace-class operators. A good definition of G ^ therefore is 




Spin((t/i©[/f)R)xz,Mp((t/o©[/o*)R) K = On, 
USp(t/i © Uf) X SO* {Uq © f/*) K = USp, 



Mr = USp(t/i ©f/f) X Mso C Spin(l^i) xz,n{W^) , 



X{m) := STr^^i?(m;Id)e^^>P*(^>) , 
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where {Fj} now is a basis of gi and {^j} is its dual basis. The symbol here denotes 
the 0-representation on ^/y. It is clear that by restricting the numerical part of A^(m) 
to the toral set C Mr we recover the function described in (I4.2I ). 

4.3.2. Weyl group. — Consider now the numerical part of the section x E ^ . Being 
a GiR-radial function, num(;t) is invariant under the action of the Weyl group W which 
normalizes with respect to the GR-action on Mr by conjugation. Since the latter 
group action decomposes as a direct product of two factors, so does V7. 

For both cases {K = Opj, USp^) the second factor of the Weyl group W is just the 
permutation group S„ . As a matter of fact, conjugation of a diagonal element to E Msp 
or to E Mso by ^ G Mp{{Uq © t/g )») ^ e SO*{Uq © Uq) can return another diagonal 
element only by permutation of the eigenvalues e"^' , . . . , e*^" of to . (No inversion e"^^ —>■ 
is possible, as this would mean transgressing the oscillator semigroup.) This 
factor S„ of W will play no important role in the following, as the expressions we will 
encounter are automatically invariant under such permutations. 

The first factors of W are of greater significance. For the two cases of ^ = 
and K = USpyy these are the Weyl groups Wso2„ and V^Spj,, respectively. An explicit 
description of these groups is as follows. Let {ei, . . . ,e„} be an orthonormal basis of 
U and decompose U (BU* into a direct sum of 2-planes, 

UQ)U* =Pl®...®Pn , 

where Pj is spanned by the vector ej and the linear form cej = {ej (j = 1 , . . . , n). In 
both cases at hand, i.e., for the symmetric form S as well the alternating form A, this is 
an orthogonal decomposition. The real torus under consideration is parameterized by 
(e^V^i, . . . ,6'"^") E (Ui)" acting by e'V'i.(ey) = ej and e''^>.(ce^) = e-'V^^cey . 

The Weyl group Wsp is generated by the permutations of these planes and the in- 
volutions which are defined by conjugation by the mapping that sends ej i— > cej and 
ccj (—> —ej . The Weyl group Wso is generated by the permutations together with the 
involutions which are induced by the mappings that simply exchange ej with ccj. 
Since we are in the special orthogonal group and the determinant for a single exchange 
ej ^ cey is — 1, the number of involutions in any word in Wso has to be even. 

In summary, the VK-action on our standard bases of linear functions, {i^^j} and {^j}, 
is given by the respective permutations together with the action of the involutions de- 
fined by sign change, ii/Zj i-^ —Wj ■ the sequel, the Weyl group action will be under- 
stood to be either this standard action or alternatively, depending on the context, the 
corresponding action on the exponentiated functions {e"''^} and {e*^^ }. 

As a final remark on the subject, let us note that the Weyl group symmetries of 
the function x{t) can also be read off directly from the explicit expression (14.21) . In 
particular, the absence of reflections ^j —^j is clear from the conditions IKe ^j > 0. 

4.3.3. Laplace-Casimir eigenvalues. — We are now ready to start deriving a system 
of differential equations for %. Recall that every Casimir element I E U(0) determines 
an invariant differential operator D{I), called a Laplace-Casimir operator, by replacing 
each element X E Q in the polynomial expression of / by or X^. 



60 



A. HUCKLEBERRY, A. PUTTMANN AND M.R. ZIRNBAUER 



Lemma 4.6. — Let % he the character of an irreducible representation (p*, p) of a Lie 
supergroup (g ,G) on a complex vector space. Then for any Casimir element / G U(0) 
the character % is an eigenfunction of the differential operator D(I). 

Proof — We have {D{I)x){g) = STrp*(/)p(g) e^>'^>''*('^>). Since / is a Casimir el- 
ement, p*(/) commutes with p*(X) for all X G g. By Schur's lemma for trace-class 
operators, p,(/) = A(/)Id with G C. Hence, D{I)x = ^{I)z ■ □ 

Recall now from S2.2.2l that for every £ G N we have a Casimir element G U(osp) of 
degree 2i. Recall also that under the assumption Vq — Vi we introduced d,d E ospj , 
A= [d,d] G ospo, andiv G U(osp) suchthat/^ = [d,Fg] and [d,A] =0. 

Let us insert here the following comment. While d,d,A were abstractly defined as 
osp-generators, they acquire a transparent meaning when represented as operators on 
the spinor-oscillator module a{V). In fact, using formula (12.81 ) one finds 

Here, for notational brevity, we make no distinction between osp-elements d, d, etc. 
and the operators representing them on a{V). It is now natural to identify the spinor- 
oscillator module a{V) (or rather, a suitable completion thereof) with the complex of 
holomorphic differential forms on Vq. Writing e(/i,/) = dzj and d{eoj) = d /dzj we 
then see that d is the holomorphic exterior derivative: 

d = l{v) becomes the operator of contraction with the vector field v = Y,Zjd/ dzj gen- 
erating scale transformations Zj e'zj , while A = [<?,<?] = (9 o i (v) + l (v) o (9 is inter- 
preted as the Lie derivative with respect to that vector field. 

Consider now any irreducible osp -representation on a Z2-graded vector space Y 
with the property that the 1^-supertrace of e^'^ (t > 0) exists. Let be the scalar 
value of the Casimir invariant Ii in the representation Y. Then a short computation 
using l£ = [d.Fa] and [d,A] = shows that A(/£) multiplied by STr;^e^'^^ vanishes: 

X{Ie) STry e"'"^ = STr fQ-'^Ig = STrre-'^[d,Fi] = STry [d,e''^Ff] = , 

since the supertrace of any bracket is zero. Thus we are facing a dichotomy: either we 
have STry/e^'"^ = 0, or else ^{Ii) = for all £ G N. Now our representation a{V)^ 
realizes the latter alternative, which leads to the following consequence. 

Lemma 4. 7. — Assuming that U = UoQ)Uiis a 2,2-8 faded vector space with Uq^Ui, 
let X £ ^(^^R,0i) be the character of the irreducible Q-representation on a{V)^ for 
V = U(^C^. Then D{k)x = Ofor all £ G N. 

Remark 4.2. — The condition Uq^U\ is needed in order for the formula I( = [d,Fg] 
of Lemma [Z9] to be available. 
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Proof. — For any real parameter t > the supertrace of the operator e on g.{V)^ 
certainly exists and is non-zero. In fact, using formula (14.21) one computes the value as 

STr„(,). e-^ = STri?(e^Id„ , e'ld„ ; Id^) = l"^}!^'^.^ ^^='^^- 
The dichotomy of A {k) STr^(^)jf e"^^ = therefore gives D{I()x = X{k)x=Q. □ 

4.3.4. Differential equations for the character. — Since the Casimir elements com- 
mute with all elements of the Lie superalgebra, the Laplace-Casimir operators leave 
the set of radial superfunctions invariant. We denote by b{Ie) the radial parts of the 
Laplace-Casimir operators D{I() for £ G N. These operators, which arise by restricting 
the Laplace-Casimir operators to the space of radial functions, are given by differential 
operators on the torus Tr. They have been described by Berezin [[1]|, and his results 
will now be stated in a form well adapted to our purposes. 

Recall from ^2.2. II that osp -roots are of the form -^'&sj ± '&tk- Recall also the rela- 
tions d-Qj = and i^ij = iv/j (7 = 1, . . . , n). In the following we regard the variables 

and as real (local) coordinates for the real torus Tr . 

For £ G N let Di be the degree-2£ differential operator 

Let J be the function defined on a dense open subset of 7r by 

, naeA+2sinh^ 
J(t) = — 



n/3eA+2sinh^ 



where A+ = Aq U A]*" is a system of even and odd positive roots (cf. ^2.6.21) . 

Proposition 4.1. — Up to a constant multiple the radial part of the differential oper- 
ator D{Ii) is of the form b{h) = J^^{Df -f Qi-i) oj where Qg-i is some polynomial 
(with constant coefficients) in the operators Dj^ of total degree less than that ofDi. 

Proof. — The first statement is a direct consequence of Theorem 3.2 of [IJ using the 
explicit form of the Casimir elements defined in equation (|2.5I) and the relations 
= ixifj and -O-qj = . The statement about the lower-order terms Qe^i is from 
Theorem 4.5 of Kfl. □ 

Corollary 4.2. — The function %: ^ C given by xit) = ST^^a{v)'^^i^'^^^N) satisfies 
the system of differential equations Di{Jx) = Ofor all £ G N. 

Proof. — From Lemma l477] we have D{Ii)x = and honce b{Ii)x\ % = for all £ G N . 
It follows by induction that Di{Jx) = for alH G N . □ 
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The methods of this section can be used to derive differential equations for the charac- 
ter of a certain class of irreducible representations of qI{U) ^ q^^\ Define 

_n;<^4sinh^^M)sinh^ 
n^Ssinh^ 

Here, — V4) i — \ j < k} and {^j — ii/^yt} the sets of even and odd positive 
roots of g(*^). The following statement is Corollary 4.12 of [4] adapted to the present 
context and notation. The idea of the proof is the same as that of Lemma 14771 

Corollary 4.3. — Let % be the character of an irreducible representation of the Lie 
supergroup (g[(i7),GL(i7o) xGL(i7i)) on a finite-dimensional Z2-graded vector space 
V = Vq®Vi. IfUQ^Ui but dim(yo) 7^ clim(yi), then De{Jox) = Ofor all £ G N. 

4.3.5. Uniqueness theorem. — Recall that the main goal of this paper can be stated 
as that of explicitly computing the character ;t of a local representation defined on the 
space of invariants ci{V)^ in the spinor-oscillator module. We have restricted ourselves 
to the cases where K is either Oyv or USp^. The representation on a{V)^ is defined 
at the infinitesimal level on the full complex Lie superalgebra g which is the Howe 
partner of K in the canonical realization of osp in the Clifford-Weyl algebra ofV(BV*. 

It has been shown that x ■ 7k ^ C satisfies the differential equations Df{Jx) = 0. 
By analytic continuation it satisfies the same equations on the complex torus T. 

Recall that r;^ denotes the set of weights of the g-representation on a{V)^. Recall 
also from Corollary 12.31 that the weights 7 = E"=i(imji//y — nj(l)j) G Ti satisfy the 

weight constraints —j<mj<j<nj. The highest weight is X = jY.iWj ^ ^j)- 

By the definition of the torus T the weights 7 G are analytically integrable and 
we now view e^ as a function on T. 

Theorem 4.1. — The character X - T ^Cis annihilated by the differential operators 
DioJ for all £ G N, and it has a convergent expansion x = L^yC^ where the sum runs 
over weights 7 = ^^i^j) satisfying the constraints — y < mj < j < nj. 

For the case of K = USp^y it is the unique function on T with these two properties 
and Bx = 1. For K = Oat it is the unique W -invariant function on T with these two 
properties and = 1, Bx-n^Yn ~ ^• 

Remark 4.3. — To verify the property Bx_■^^^^^ = which holds for the case of ^ = 
Om , look at the right-hand side of the formula of Corollary 14. 1[ in order to generate 
a term e^ = e'^"^'''" in the weight expansion, you must pick the term e^^'''" in the 
expansion of the determinant for j = n in the numerator; but the latter term depends 
on k as Det{—k) which vanishes upon taking the Haar average for K = Op^ . By W- 
invariance the property ^A-iA^v/,, = is equivalent to Bx_^j^^. = for all j . 

In view of this Remark and Corollaries 12.31 and 14.21 it is only the uniqueness state- 
ment of Theorem |4?T] that remains to be proved here. This requires a bit of preparation, 
in particular to appropriately formulate the condition Dii^Jx) = . For that we develop 
JX in a series Jx = Lt '^t/t where the fx are D^-eigenfunctions for every £ G N . 
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The first step is to determine an appropriate expansion for J. Recall that 



J 



a a , 



^1 

Given a factor in the denominator of this representation, we wish to factor out, e.g., 

e^^ to obtain a term (1 — e^^)^^ which we will attempt to develop in a geometric 
series. In order for this to converge uniformly on compact subsets of T it is necessary 
and sufficient for /3 to be positive on t. This of course depends on the root j8 . 

Fortunately, the sets of odd positive roots for our two cases oiK — On and K — USp^ 
are the same (see §12.6.21) : 

^t = {(l)j±Wk\j,k=l,...,n}. 

So indeed, if we factor out e ^ from each term in the denominator and do the same in 
the numerator, we obtain the expression 



,n«eA,t(l-e-«^ 

e 



n^eA^(i-e-^)' 

and it is possible to expand each term of the denominator in a geometric series. Here 

is half the supersum of the positive roots. 

Now let {c7i , . . . , Or} be a basis of simple positive roots (cf. §12.6.21) and expand the 
terms (1 — e^^)^^ in geometric series to obtain 

y = e^£A,e^^ 

b>0 

which converges uniformly on compact subsets of T. In this expression b and o de- 
note the vectors b = {pi,. ..,br) and cr = (ai, . . . , C7^), respectively, and bo := Y^biOi . 
Following the usual multi-index notation, b>0 means bi > for all i . Note Aq = I. 
Now we know that the character has a convergent series representation 



r 



r 

Thus we may write 

JX= l5rlA,e^+^+^-. 

r&x h>o 

For convenience of the discussion we let 7 := y+bo and reorganize the sums as 
where the inner sum is a finite sum which runs over a\\b>0 such that f — boETx. 



JX = Y.[L^bBf-ba)o'^^, (4.3) 

f 
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We are now in a position to explain the recursion procedure which shows that % 
is unique. Start by applying D( to ]% as represented in the expression (14.31) . Since 
5 + 7 is of the form YX^^k^k ~ ^k^k)^ we immediately see that it is an eigenfunction 
with eigenvalue E{t,f) := ( — 1)^L(^|^ ~^k^- The functions e^"^^ in the sum are 
independent eigenfunctions. Hence it follows that 

= £(£,7)£A,5^_t^ (4.4) 

for all 7 fixed and then for all £ G N . 

From now on we consider the equations (14.41) only in those cases where 7 is itself a 
weight of our representation. (We have license to do so as only the uniqueness part of 
Theorem l4. 1 [ remains to be proved.) In this case we have the following key fact. 

Lemma 4.8. — IfY^^x '^^d the eigenvalue E{£, 7) vanishes for all £ G N, then 7 is 
the highest weight A. 

Proof. — Our first job is to compute d. For the list of even and odd positive roots we 
refer the reader to ^2.6.2[ Direct computation shows that if K = 0p^, then 

n 

S = £(fc-l)(iV^n-A:+l-0/t) • 

k=l 

The same computation for the case of ^ = USp^ shows that 

n 

5 = J^fc(iV4-0„-fc+i) • 

k=l 

Now we write 7 = Y.ki^'^kVk ~ ^k^k) with the weight constraints —^<mi,<^<nf^. 
The assumption that 7) vanishes for all I means that 

£(m„_,+i +k-\f^ = + k-\f^ for all I 

k k 

in the case oi K = . In the case of ^ = USp^ it means that 

£(m„_,+i +kf^ = + kf^ for all I . 

k k 

In the second case the only solution for and nj^ satisfying the weight constraints 
is the highest weight A itself. In the first case there is one other solution, namely 
that which is obtained from the highest weight by replacing m„ = y by m„ = — y . 
However, one directly checks that in the Oyy case, where 2ii//„ is not a root, it is not 
possible to obtain such a 7 by adding some combination of roots from g^^) to A . □ 

We are now able to give the proof of the uniqueness statement of Theorem 14.11 

Proof. — We will determine By recursively, starting from = \. Let 7 7^ A be a 
weight that satisfies the weight constraints. Then if ^ = USp^y we know that 7) is 
non-zero for some I . It therefore follows from equation (|4.4I) and Aq = 1 that 

= By + Y.^j,By_ba, (4.5) 
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where the sum runs over all b ^ (recall that b > is always the case) such that 
J— bo E Fx . Since the weights y — bo involved in the sum are smaller than 7 in 
the natural partial order defined by the basis of simple roots, equation (14.51) defines a 
recursion procedure for determining all coefficients By . 

In the case of ^ = Oyy we are confronted with the fact that the weight y = X — \N\ifn 
satisfies the weight constraints and yet gives E{£,y) = for all i. However, in this 
exceptional situation the conditions of Theorem |4. 1 [ provide that Bx_^j^^^ = 0. Thus the 
expansion coefficients By are still uniquely determined by our recursion procedure. □ 

4.3.6. Explicit solution of the differential equations. — As before let A+ be a set of 
positive roots of = osp{U (BU*) or osp{U (BU*). We now decompose these sets as 

A+ = A+ U (A+ \ A+) , A+ := {a G A+ | 0« c g^-^)} , 

which means that A+ \ Aj^ is a set of positive roots of g(^). Let be further de- 
composed as A = A^ Q U A^ ^ where A ^ and A^ ^ are the subsets of even and odd 

A -positive roots. Then the function J has a factorization as 7 = JqZ^^c^' with 

and 5' = ^ (£ a — is half the supersum of A-positive roots. For the case of ^ = O^^ 

one finds 5' = —jY.{Wj ~ ^j) = while for K = USp^ one has 5' = Xi. 

The Weyl group W acts on T and therefore on functions on T. Let C W he 
the subgroup which stabilizes the highest weight X = Xj^ and thus the corresponding 
function e'^ on T. Note that Wx is the direct product of the permutations of the set 
{e*^^} and the permutations of the set {e"''^}. The symmetrizing operator Sw from 
W;^^ -invariant analytic functions to PF-invariant analytic functions on T is given by 

%(/) := E vv(/) . 
[w]eW/Wi 

Notice that the function e^Z is -invariant; the symmetrized function Swi^^^Z) 
then is V7-invariant. We now wish to show that this function coincides with our char- 
acter X- In this endeavor, an obstacle appears to be that e^x by Corollary 14. H is a poly- 
nomial in the variables e^'^'i , . . . , e"''", whereas the function Z has poles at 6''^'''-'+'''*^ = 1. 
Hence our next step is to show that these poles are actually cancelled by the process of 
V7- sy mmetrization . 

Lemma 4.9. — The function Siy (e'^Z) is holomorphic on n"^j{9^e > 0}. 

Proof. — An even root oc e Aq is some linear combination of either the functions 
or the functions y/) . Denoting the latter subset of even roots by Aq (i//) C Aq , let 
T.a CT for a G Aq ( i//) be the complex submanifold 

E„:={?Gr|e«(0 = l}. 
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By definition, the function Sw (e Z) is holomorphic on 

(n;ume(^),>o})\(u„^^+(^)E«) . 

Now it is a theorem of complex analysis that if a function is holomorphic outside an 
analytic set of complex codimension at least two, then this function is everywhere 
holomorphic. Therefore, since the intersection of two or more of the submanifolds 
is of codimension at least two in T, it suffices to show that for any a G Aq (i//) our 
function Swi^^Z) extends holomorphically to 

Da :='^a\(^^A+(\i/)3a'^a^a'^ ■ 

Hence let a be some fixed root in Aq ( i//) . There exists a Weyl group element w eW 
and a w-invariant neighborhood U of Da such that w: U ^ U is a reflection fixing the 
points of Da ■ Let Za '■ U ^ C he a complex coordinate which is transverse to Da in 
the sense that w{za) = —Za ■ Because the root a occurs at most once in the product Z, 
the function Sw(e'^Z) has at most a simple pole in za ■ We may choose U in such a way 
that Sw (e'^Z) is holomorphic onU\ Da ■ Doing so we have a unique decomposition 

Sw(e^Z) = —+B 

Za 

where A and B are holomorphic in U. Since Swi^^Z) is W-invariant, we conclude that 
w{A) = —A and hence A = along Da ■ □ 

Lemma 4.10. — For alli,N eN the function (p : T defined by (p = Sw (e'^'^Z) is 
a solution of the differential equation Dp{J(p) = 0. 

Proof. — Using Z = e^'jo/J we write (p = Sw {q^^^^' Jo / J) ■ Then, lifting the sum 
over cosets [w] G to a sum over Weyl group elements w G we obtain 

ord{Wx)J(p = J £ w(e^^+^'7o/^) = £ sgn(w) w(7oe^'^+^') , 

where w i— > sgn(w) G Z2 = {±1} is the determinant of w eW C 0(t) = 02n ■ 

The factor e'^'^^^' is the character of the representation (^^^STr,SDet^) of (a 

double cover of) the Lie supergroup {g^^\GL{UQ) x GL{Ui)). This representation is 

one-dimensional, and from Corollary 14.31 we have Di^Jqc^^^^ ) = for all £,A^ G N. 
The statement of the lemma now follows by applying the V7-invariant differential 

operator Dg to the formula for ord( W;^ above. □ 

4.3.7. Weight constraints. — Here we carry out the final step in proving the explicit 
formula for the character x of our representation. Since the formula in the case of 
K = SOn follows directly from that for K = On (see §[I]) and the case of K = Ua? has 
been handled in [4], we need only discuss the cases of ^ = and K = USp^ . 
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In order to show that the character is indeed given hy x — ^ with q> = Swi^^Z), it 
remains to prove that in the series development 9 = I^5ye^ of the function defined by 

n«eA+ (i-e-^(^)) 

[w]eW/W^ llaeA+,y ^ y 

the only non-zero coefficients By are those where the linear functions 7 are of the form 
Y = '^{inikXl/k — n]^^k) with —^<m]^<^<ni^. We also have to show that 5y = in 
the case of the exceptional weight y= X —iN'^n occurring for K = 0;v • 

We have shown above that 9 = Swi^^Z) is holomorphic on the product of the full 
complex torus of the variables e"'^* with the domain defined by > • Although 
the individual terms ^^^^.j in the representation of 9 have poles (which cancel in the 
Weyl group averaging process) we may still develop each term of ^ in a series expan- 
sion; this will in fact yield the desired weight constraints. 

We begin with the situation where K = . In this case A'^ ^ consists of the roots 

ixj/j + i\i/k (j < k) and <j)j + <j)k (j < k), and j is the set of roots of the form ii/Ay -|- (j)^ 
{j,k= 1 , . . . , n). Let us first consider the term of <p where \w] = . Its denominator 
can be developed in a geometric series on the region corresponding to <j>k> for 
all k. There we may write this term as 

Here and for the remainder of this paragraph a runs through the A -positive even roots 
and j8 through the A -positive odd roots. 

Recall that = j HiWk — 0fe)> and note that all powers of e^'''* and e"^* occurring in 
the series expansion of 

n(i-^"'')ni^""" 

are non-positive. Thus, if 7 = Y^{imk\]/k — nk(j>k) is a weight which arises in ^[y] , then 
% > y and mk<j.ln the case of the nik this is a statement only about the term ^[y] , 
but, since the action of the Weyl group on the variables is just by permutation of 
the indices, it follows that > y holds always, independent of the term cp^^.^ under 
consideration. Hence, we neglect the in our further discussion and only analyze the 
powers of the exponentials e^"''* which arise in the other terms (p^^^ . 

Given a fixed index k E {!,...,«} we will develop every term ^j^j on a region R = 
R{k) defined by certain inequalities which in the case of A: = 1 are 

mt{iYi) > . . . > 9^e(iVA-„) > . 

We now discuss this case in detail. 

Recall that iy^i occurs in the denominator in factors of the form 

(1 _e-^("))-i = (^i-Q-^i^Vi)-'^{Wj)yi 

for J > 1 . If w{i\j/i) = ii/Ai , then we expand these factors just as in the case of ^[y] . 
Convergence of the resulting series is guaranteed no matter what w does to Yj ■ 
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In the situation where w(ii//i) = — ii/Zi we rewrite the factors in the denominator 

as (1 — e^"'('^))^^ = — e^'^^*^")(l — e^*^^*^"))^^ and expand, and convergence in R is again 
guaranteed. Adding these series we obtain a series representation 

[w] 7 

which is convergent on R . 

Lemma 4.11. — If J = Y^i^m^Wk — nk^k) and By ^Q, then mi < j. 

Proof. — If ^(iv/i) = iV^i , then by the same argument as in the case of [w] = [Id] we 
see that e"^' occurs in the series development of (pj^^.j with a power mi of at most j . 

Now suppose that w(iv/i) = — ii/^i . Then, following the prescription above we 
rewrite the i//i -dependent factors in (pj^^.j as 

,^.a.,) n,M(l-e->K^v-.+f)) n,M(e-'V--e-^0 

and expand the r.h.s. in powers of e^"'''. It follows that in this case mi < —j + l, 
which for any positive integer implies that mi < y . □ 

Using Weyl group invariance, this estimate for mi will now yield the desired result. 

Lemma 4.12. — Suppose that K = Oyv and let (p = £5ye^ be the globally convergent 
series expansion of the proposed character ^ = 5^v(e'^Z). Then for every weight y = 
YX^'^k^k — nk^k) with By^O it follows that —j < < j < n^. 

Proof. — The inequality nk> ^ was proved above as an immediate consequence of 
the fact that the Weyl group W effectively acts only on the i/Zj . 

Above we showed that on the region R the proposed character cp has a series de- 
velopment where in every 7 the coefficient mi of ii//i is at most j . Recalling the fact 
that the function (p is holomorphic on T, we infer that mi < j also holds true for the 
globally convergent series development ^5ye^. 

To get the same statement for ii//^ with 7^ 1 we just change the definition of R to 
R{k) defined by the inequalities 9^e(iV4) > '^'^(Wi) > • • • > 0. Arguing for general 
k as we did for ^ = 1 in the above Lemma, we show that the coefficient of ixif^ in 
every 7 in the series expansion of every ^j^j on R{k) is at most j . By the holomorphic 
property, the same is true for the global series expansion of the proposed character q>. 

Hence, to complete the proof we need only show the inequality m^t > —j. But for 
this it suffices to note that for every k there is an element w of the Weyl group with 
w(ii/4) = — iV^/t- Indeed, using the Weyl invariance of cp, if there was some 7 where 
nik < — J , then the coefficient of in w{y) would be larger than j . □ 

To complete our work, we must prove Lemma 14.121 for the case K = USp^ . For this 
we use the same notation as above for the basic linear functions, namely ixj/k and ■ 
Here, compared to the case, there are only slight differences in the A -positive roots 
and the Weyl group. The only difference in the roots is in A^^ where ii//y + ii/4 occurs 
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in the larger range j <k and + in the smaller range j < k. The Weyl group acts 
by permutation of indices on both the ii/Zj and and by sign reversal on the ii^j . In 
this case, as opposed to the case above where only an even number of sign reversals 
were allowed, every sign reversal transformation is in the Weyl group. 

In order to prove Lemma 14.121 in this case, we need only go through the argument 
in the Oa^ case and make minor adjustments. In fact, the main step is to prove Lemma 
14.1 H and, there, the only change is that the range of j for the factor 1 — e^^iVi+Vj) jg 
larger. This is only relevant in the case w(ii//i) = —ixj/i , where we rewrite the additional 
denominator term (1 - e-'^^-^'^^i))-'^ as -e^^^Viy^^ Hence the factor in 

front of the ratio of products on the r.h.s. of equation (14.71) gets an additional factor of 
g-Sivi j^Q^ jg g-i( 2-+i)v/i Thus mi < — Y — 1 which certainly implies mi < j . 

Let us summarize this discussion. 

Theorem 4.2. — For both K = On and K = USp^ every weight j = Y.i^'^kWk — >^k^k) 
occurring in the series expansion Swi^^Z) = Y,Bye^ obeys the weight constraints 

N N , ^ 

<mk<^ <nk {k=l,...,n). 

Moreover, using the fact that the Weyl group transformations for K = always 
involve an even number of sign changes, one sees that B^_^^^^ = in that case. As a 
consequence of the uniqueness theorem (Theorem 14. II) we therefore have 

X = Sw (e^Z) = y ^ 

in both the Ojy and USp^y cases. Since the SO^ case has been handled as a consequence 
of the result for Oa^ , our work is now complete. 
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